REAL SECOND ORDER FREENESS 
AND HAAR ORTHOGONAL MATRICES 



JAMES A. MINGO(*), MIHAI POPA(*)(«, AND C. EMILY I. REDELMEIER(t) 

Abstract. We demonstrate the asymptotic real second order free- 
ness of Haar distributed orthogonal matrices and an independent 
ensemble of random matrices. Our main result states that if we 
have two independent ensembles of random matrices with a real 
second order limit distribution and one of them is invariant under 
conjugation by an orthogonal matrix, then the two ensembles are 
asymptotically real second order free. This captures the known 
examples of asymptotic real second order freeness introduced by 
Redelmeier |Ri] [R^l - 



1. Introduction 

The large behaviour of random matrices has been actively studied 
since Wigner's celebrated semi-circle law was found in 1955, [w]. Sub- 
sequently in 1967 Marchenko and Pastur found the limit distribution 
for Wishart matrices jMPij , now called the Marchenko-Pastur distribu- 
tion. The essential point of these discoveries is that for many ensembles 
of random matrices the description of the distribution of the eigenval- 
ues gets much simpler in the large N limit. Much subsequent work has 
been devoted to expanding and refining this work, see for example the 
recent book of Anderson, Guionnet, and Zeitouni [AGzj . 

Another direction of research in random matrices deals with the in- 
teraction of independent ensembles of random matrices. In this direc- 
tion one studies the limit eigenvalue distribution of sums and products 
of ensembles whose limit distributions are already known. The direc- 
tion was discovered by Voiculescu in his work on free probability. In 
jvTl and later in ^v^, Voiculescu showed that independent ensembles 
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were asymptotically free if at least one was unitarily invariant. Re- 
call that if two random variables are freely independent then there is 
a universal rule for finding the mixed moments from the moments of 
the individual random variables. One does this either analytically by 
using the R and S transform, see jvDNj . or combinatorially using free 
cumulants, see [Nsj . 

In the last two decades the fluctuations of the eigenvalues have been 
studied both in the physics and the mathematics literate, see e.g. [azJ 
iBSl iFMPt m El iKKPj . In [mn] it was shown that the fluctuations of 
Wishart matrices could be analyzed using the non-crossing diagrams 
introduced in |s], but by using an annulus instead of a disc or line, 
see Figure [T| hence all the combinatorial techniques developed by Nica 
and Speicher [ns] could be brought to bear on the study of fluctuations. 



Thus motivated, second order freeness was introduced in jMs; Imss] and 
later higher order freeness in [cMSSj . 

The point of second and higher order freeness is that it enables one 
to do for fluctuation moment and higher order trace-moments what 
Voiculesu's first order freeness did for moments. In particular if two 
random variables are second order free and one knows the moments 
and the fluctuation moments of each variable then there is a universal 
rule f or find ing fluctu ation moments of sums and products, see [MSTj . 

In jcMSS , imn^ ims^ iMSsj the random matrices considered were ei- 
ther Hermitian or unitary. This left the question of how to deal with 
real symmetric and orthogonal matrices. On the first order level the 
techniques of Voiculescu were equally applicable to real and complex 
ensembles. However it was shown in jR^J [Rg] that the universal rule 
found in jMS] needed to be modified for the real case; in particular the 
transpose of the various operators made an appearance. This led to a 
new kind of second order freeness, called real second order freeness in 

[RBIli]- 

The non-crossing diagrams introduced in [mn] had to augmented by 
diagrams in which the orientation of one of the circles was reversed. 
The operators on the reversed side get transposed. One can give a 
heuristic interpretation of this using maps on surfaces, see [lz]. In the 
complex case we only work with orientable surfaces and in the real case 
we also have to also deal with non-orientable surfaces. So we imagine 
that our surfaces are marked our operators and the graphs tell us how 
they get multiplied, see Figure |5| Wherever we put an operator on 
the front side of the surface, we put its transpose on the back. The 
non-orientability of the surface means that we can cross from font to 
back and see the transposed operators, something that we cannot do 
in the complex case. 
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The main result of this paper, Theorem 54, asserts that if {Ai}i and 
{Bj}j are independent ensembles of random matrices and if at least one 
of them is invariant under conjugation by an orthogonal matrix then 
the ensembles are asymptotically real second order free. The proof of 
this theorem occupies nearly the whole paper. This theorem is the 
orthogonal version of a theorem in |mss] . where we assumed that one 
of the ensembles is invariant under conjugation by an unitary matrix. 
While the statements of the two theorems are similar the proofs follow 
quite different paths. In |mss| the asymptotics of the cumulants of the 
unitary Weingarten function, from [c], were heavily used. In this paper 
we only need the multiplicitivity of the leading order of the orthogonal 
Weingarten function, see jcsj . We work with centred elements and 
this obviates the need to work with the cumulants of the Weingarten 
function. 

Illustrative examples. Let us conclude this introduction with some ex- 
amples. Suppose that Ai, A2, A^, are d x d deterministic matrices 
and O is a d X d Haar distributed random orthogonal matrix and U 
he & d X d Haar distributed random unitary matrix. From |mss[ Prop. 
3.4] we have 

E{Tt{UAiU-^A2)) = d-^TT{Ai)TT{A2) and 

E{Ti{UAiUA2)) = 0. 
According to Proposition [12] 

E{Tt{OAiO-^A2)) = d-^ Tr(Ai) Tr(A2) and 

E(Tr(OAiOA2)) = rf-iTr(AiA*). 
So we already see a bit a difference between the orthogonal and unitary 
cases; namely the appearance of transposes in lower order terms. When 
we consider covariances we see more differences. First in the unitary 
case we have 

coY{TT{UAiU-^A2), Tt{UAsU~^A4)) 

' Tr(Ai)Tr(A2)Tr(A3)Tr(A4) 



1-d- 



-2 



-2 



+ Y:—p-2 Tr(^i^3) Tr(A2A4) 



d 



-3 



l-d- 



2 {Tr(AiA3) Tr(A2) Ti{A^) + Tr(Ai) Ti{A2A,) Ti{A^)} . 
Now in the orthogonal case we have 
(1 + d-^- 2d~^) cov{Ti{OA^O-^A2), TriOAsO'^A^)) 
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= d-'{^IiA^) Tr(A2) TiiA-,) TiiA,) 
+ Tr(A)Tr(A2)Tr(4)Tr(Ai)} 
- d~^TT{A,A;) Tt{A2) Tt{A,) + Tt{A,AI) TriA^) Tt{AI) 

+ Tr(Ai) Tt{A2A^) Tt{As) + Tt{A,) Tr(A24) Tr(4)} 
+ + d-3){TT{A,A3) TiiA^A,) + Tr(Ai4) Tr(A24)} 

- rf-3{Tr(Ai4) MA2A,) + Tt{A,A,) TiiA^Al)}. 

Note the similarity to the unitary case except that each term of 
leading order appears twice-once with no transposes and once with 
transposes on A3 and A4. Moreover when the Aj's are centred, i.e. 
TT{Ai) = 0, the only remaining terms are TrlAiA^) Tt{A2A4) and 
Tr(Ai^l) Tr{A2A\). These terms correspond to spoke diagrams which 
are discussed in the next section, see Figure [Tj By working with cen- 
tred elements the number of terms is significantly reduced, it is in this 
way that we can skip the calculations requiring the cumulants of the 
Weingarten function. 



The Organization of the Paper. In section|2]we review the definitions of 
non-crossing partitions. In section |3] we use the Weingarten function of 
jcsj to compute the trace of a product of orthogonal matrices and inde- 
pendent random matrices. This is how the calculations in the examples 
above were done. In section |4] we prove two important lemmas on a 
special kind of non-crossing partition called a spoke diagram. These 
are the only diagrams that survive in the large d limit. In section [5] we 
recall the notions of second order freeness from jRij , [Rj] and prove that 
real second order freeness satisfies an associative law. In section |6] we 
prove that Haar distributed orthogonal matrices and an independent 
ensemble are first order free. That this could be done was already sug- 
gested by Voiculescu in |Vij some twenty years ago and was later proved 
in jcs^ Thm. 5.2]. In section [T] we show that the fluctuation moments 
of Haar distributed orthogonal matrices and an independent ensemble 
of random matrices satisfy the universal rule required for second order 
freeness. In section |8] we show that the third and higher cumulants of 
traces of products of Haar distributed orthogonal matrices and an in- 
dependent ensemble of random matrices satisfy the final condition for 
asymptotic real second order freeness. This completes the proof of their 
asymptotic real second order freeness. In section |9] we use this result 
to obtain all our other results on asymptotic real second order freeness. 
In section 10 we present some concluding remarks and indications of 
future work. 
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2. Non-crossing diagrams and pairings 

Central to the combinatorial approach to freeness is the idea of a non- 
crossing partition. A partition of [n] is non-crossing is one in which the 
blocks can be drawn in a non-crossing way; see the left half of Figure 
[1} For second order freeness we need non-crossing annular partitions. 
This means we can draw the blocks on an annulus in a non-crossing 
way; see the right half of Figure [1} In the case of second order freeness 
additional information about the partitions is needed, namely the order 
in which they visit the points. For this reason we regard our partitions 
as permutations by interpreting the blocks of the partition as cycles in 
the cycle decomposition of the corresponding permutation. 

Notation 1. For any integer n > 1, let [n] = {1, 2, 3, ... , n}. Let V{n) 
be the set of all partitions of [n]. For any partition vr of [n] let #(7r) 
denote the number of blocks of vr, and |7r| = — #(vr). The set V{n) 
is a partially ordered set in which n < a means every block of tt is 
contained in some block of a. With this order V{n) is partially ordered 
set and is in fact a lattice. We denoted the join of two partitions tt and 
(J by TT V cr. 

Given a permutation it can be difficult to decide if there is a non- 
crossing way of drawing its cycles, however there is an algebraic way to 
see if such a diagram exists. Let 7 = (1, . . . , m)(m + 1, . . . , m + ra) and 
let TT be a permutation of [m + n] and denote by {tt,'-/) the subgroup 
of Sn generated by tt and 7. If the subgroup (vr, 7) acts transitively on 
[m + n] then we have that tt is non-crossing if and only if 

#(7r) + #(7r-S) =m + n. (1) 

Note that the condition that (vr, 7) act transitively is the same as re- 
quiring that there is at least one cycle of tt that contains points in both 
cycles of 7. When this happen we shall say that tt connects the cycles 
of 7 

We can extend this to the case of 7 having any number of cycles. 
Let TT and 7 be permutations of [n]. Let k be the number of orbits of 
(71,7). Then 

#(7r) + #(7r-S) + #(7)<n + 2A; (2) 

with equality only if tt is non-crossing with respect to 7, see e.g. [mn^ 
Remark 2.11]. 

In the case of real second order freeness we require an additional set 
of non-crossing diagrams, we call these reversed non- crossing annular 
permutations. If we let 7' = (1, . . . , m) {m+n, m+n—1, . . . , m+2, m+1) 
then we say that a permutation tt G Sm+n is a reversed non-crossing 
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Figure 1. On the left we have the non-crossing 
disc permutation (1, 2, 4)(3)(5, 7)(6). On the right we 
have the non-crossing annular permutation (1,2,9,7) 
(3,4,6,8)(5). 



permutation of a (m, r;,)-annulus if 

#(7r) + #(7r-V) = ^ + n. 

Notice that this is the same condition as in Equation ([T]) but 7 is 
replaced with 7'. Graphically, this corresponds to using the same ori- 
entation for labelling the points on each circle; see the right hand side 
of Figure [2j 

A special kind of a non-crossing annular permutation that we shall 
make use of is that of a spoke diagram, see Figure [2j Recall that a 
pairing of [n] is a partition in which each block has two elements. We 
usually regard a pairing as a permutation, by considering each block to 
be a cycle with two elements. By a standard spoke diagram we mean 
a non-crossing pairing of an (m, 'n,)-annulus in which all pairs connect 
the two circles. Note that means that m = n and there is / such that 
m + 1 < I < 2m such that every cycle of p is of the form [k, '-f~^{l)) for 
1 < k < m. 

By a reversed spoke diagram we mean a reversed non-crossing annu- 
lar pairing in which all blocks connect the two circles; see Figure |2} By 
a spoke diagram we mean either a standard or reversed spoke diagram. 
See Figure [2j Note that means that m = n and there is / such that 
m + 1 < / < 2m such that every cycle of p is of the form {k, '~f^{l)) for 
1 < k < m. 

We denote by V2{n) the pairings of [n]. If j9 is a pairing of [n] and 
(r, s) is a cycle of p we shall denote this by (r, s) G p. We denote by 
Sp'^ijn) the set of all standard spoke diagrams and by Sp~{m) the set 
of all reversed spoke diagrams. 
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Given a permutation vr G 5*^, we shall frequently consider the cycles 
of vr as a partition of [n]. This map Sn — V{n) forgets the order 
of elements in a cycle and so is not a bijection. Conversely given a 
partition vr G V{n) we put the elements of each block into increasing 
order and consider this a permutation. Restricted to pairings this is a 
bijection. 

3. The Trace of a Product 

Given a permutation cr G S'„ and d x d matrices Ai, . . . , An we let 
ap}q be the {p, g)-entry of Ai and 

TrMu---,An)= «a..)---J:M„)- (3) 

il,...,jn = l 

This expression can also be written as a product of traces as follows. 
Write 0" = Ci ■ ■ ■ Cfc in cycle form. If c = (ii, . . . , v) is a cycle of cr we 
let Tr,(Ai, ...,An)= Tr(Ai, • • • A^J. Then 

k 

Tr,(Ai,...,A„) = JjTre,(Ai,...,A„). 

1=1 

Let O = (ojj) he a dx d Haar distributed random orthogonal matrix 
and {Yi, . . . , Yn} he dxd random matrices whose entries have moments 
of all orders. Let 7 G 5'„ be a permutation, and let €1,62, ... ,en G 
{ — 1, 1}. In this section we wish to find a simple expression for 

E(Tr^(O^^Fi,...,0^"F„)). 

We shall use the Weingarten function introduced by Collins and 
Sniady [csj. The Weingarten expresses the expectation E(oj^j_^ ■ ■ ■ 
Oj„i_„) as a sum over pairings of [n]. The first question we need to 
address is, for two pairings p and q, the relationship between the cycles 
of pq and the blocks of p V g. See Figure [3j This is a standard fact; for 
the reader's convenience and to establish our notation we give a proof. 

Lemma 2. Let p,q G V2{n) be pairings and {ii,i2, . . . ,ik) a, cycle of 
pq. Let ir = q{ir). Then (jfc, jfc-i, • • • , ji) is also a cycle of pq, and 
these two cycles are distinct; {i, . . . ,ik,ji, • • • ,jk} is a block of p\/ q 
and all are of this form; 2^{p V g) = 4i^{pq). 

Proof. We have pqiir) = ir+i, thus jV = q{ir) = piir+i)- Hence 
PqUr+i) = = = >• if ■■.,ik} and {ji, . . . , jfc} 

were to have a non-empty intersection then, for some n, q{pq)" would 
have a fixed point, but this would in turn imply that either p or q 
had a fixed point, which is impossible. Since {q{ir)}r = {js}s and 
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Figure 2. On the left we have a non-crossing pairing 
of a (6, 6)-annulus in which all blocks connect the two 
circles, i.e. a standard spoke diagram. Note that the two 
circles have opposite orientations. In the figure on the 
right we have a reversed non-crossing pairing of a (6, 6)- 
annulus. i.e. a reversed spoke diagram. Note that the 
two circles having the same orientation. 



Figure 3. In this example n = 8, p = (1,2)(3, 5) 
(4,8)(6,7), and q = (1, 6)(2, 5)(3, 7)(4, 8). Then pq = 
(1, 7, 5)(2, 3, 6)(4)(8) and p V g = {(1, 2, 3, 5, 6, 7)(4, 8)}. 



{p{js)}s = {v}r, {i, ■ ■ ■,ik,ji, ■ ■ ■ ,jk} must be a block of p V g. Since 
every point of [n] is in some cycle of pq, all blocks must be of this form. 
Since every block of p V g is the union of two cycles of pq, we have 



Notation 3. Let [—n] = {—n, —n + 1, . . . , —2, —1} and [in] = [—n] U 
[n]. Let 5 be the permutation of [±n] which sends k to —k for k G [±^]. 
Since each cycle of 5 is of the form {k, —k), we shall also regard 5 as a 
pairing of [±n]. If e G Z2 = { — 1, 1}"", let 5^ denote the permutation of 
[±n] given by A; H- e\k\k. 

Given vr a permutation on [n] we shall regard vr also a permutation 
of [±n] where for 1 < < n, we let 7T{—k) = —k. Let 7 be the 
permutation of [n] with the one cycle (1, 2,3, ... ,n), but following the 
convention mentioned above we also have 7(— /c) = —k for 1 < k < n. 




2#(pVg) = #(M)- 



□ 
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Lemma 4. Letp,q G V2{n) he pairings then i^{pq) = i^{pSq). 

Proof. Note that for 1 < A; < n we have p5q{k) < and p5q{—k) > 0. 
Thus the elements in an orbit of p6q always alternate in sign. More- 
over {p5qY — pq. Hence the positive elements of a cycle of p5q form 
a cycle of pq. Conversely let {ii,i2, . . . ,ir) be a cycle of pq. Then 
{ii, —q{ii),i2, —(li'i2), • • • ! ir, ^^(v)) is a cycle of p6q. This establishes 
a bijection between the cycles of pSq and the cycles of pq. □ 

The pairings of [±n] shall be denoted 7^2 (=t^)- For a pairing p G 
P2(=t^)) and a 2n-tuplc i = {ii, . . . ,in, i^n) we write i = i o p to 
mean that whenever p{r) = s we have ir = is- For a. dx d matrix A let 
A^~^^ — A^, the transpose of A, and A^^^ — A. For rj — {rji, 772, ■ ■ ■ , Vn) £ 
and TT G Sn, let TV(,,^)(Ai, . . . , = TV,(AS''^\ . . . , A^^) 

Lemma 5. Le^ p G P2(±^)- T/ie i/iere is n E Sn and 77 G Z2 sttc/i it/ia^ 

/ V "ni_i"i2i-2 "'iki-k "'ini-n ~ ^'■■^y^l ) • • • ) J 

Proof. We saw that the cycle decomposition of pS may be written 
ciCi' • • • CsCs where c/ = 5Cj~^5. It is arbitrary which of the pair 
is called q and which c/. 

For each i, choose a representative of each pair {q, c/}, say Ci, C2, . . . , 
Cg. For each i wc construct a cycle follows. Suppose Cj = 

(Zi, . . . , /^). Let Ci = (ji, j2, • • ■ Jr) where 

7a; = S and rvo, = 

^ \lk lk>0 

Note that jk = Vjk^k = Then we let tt = ci • • • and 77 = 

{Vi,---,Vn)- 

We denote the (m,n) entry of A^"'^ by a^%'^ Let {h, /,,) be a 
cycle of pS. Let (ji, . . . , ji) and (771, . . . , 77^) be as above i.e. jk — \lk\ 
and 77j^ = lk/\h\- Then 




'3fc ''-Jk 



Sjk,rijk) 
-Jk 

-3fc ^Jk 




Thus 
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Note that i-i^ = i{S{lk)) = i{pS{lk)) = i{lk+i) = as i = iop. Thus 



(1) (2) (fc) (n) 

n • • • n • • • n 

"'121-2 Ik^-k Inl-n 



il,...,i-n = l 

i=iop 



^ n 

i=iop C=(jl,...Jr) 



Ci," , • • • (Jj. 



E n 

■,«2n = l CStt 

=iop c={ji,... 
-LJ-ttI^I ; • • • ; 



«lvi«2n = l cStt 
i=iop c=(ji,...,>) 

C=(ilvJr) 



□ 



Remark 6. The pair (vr,?]) constructed in Lemma[5]is not unique; how- 
ever since 

Tr(A;.''^^^ ■ ■ ■ a;."-^) = Tr(A;-''-) ■ ■ ■ a;.""^'^^) 

v Jl Jr ^ Jr Jl 

the value of Ttt,{A^^^ \ . . . , An"'^) is independent of the choices made. 

Notation 7. Let C[V2{n)] be the inner product vector space with 
orthonormal basis V2{n). For an integer d > n, define cp : C[V2{n)] — > 
C[V2{n)] by 

In [cs^ §3], Colhns and Sniady showed that ip is an invertible hnear 
transformation and denoted its inverse Wg, the orthogonal Weingarten 
function. From the construction, (Wg(p),g) is always a rational func- 
tion of d. Collins and Sniady showed jcsl Thm. 3.13] that given 
p,q ^ V2{n) if we expand in power series in d~^ then we have 

(Wg(p),g) = 0(c/-"+#(^'^«)). (4) 

Remark 8. It was shown in jcsj that the coefficient of can 
be written as a product of signed Catalan numbers. Indeed, write 
pq = pqp~^q and factor p into a product of cycles Ci ■ ■ ■ Ck- Let Cm be 
the m^^ Catalan number C"") . Then the coefficient of 
is 

(-ir-^a.-i---(-i)'-''-^a,-i 
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where the i*'* cycle q has elements. 

The reason for introducing Wg is its use in computing matrix ex- 
pectations. For pairings p,q & V2{n), p6q6 is a pairing of [±n]. For a 
pairing r of [±n] and ii, . . G [d\ we let 5* = 1 if = it 

whenever (s, t) is a pair of r and otherwise. 

Theorem 9 ([csl Cor. 3.4]). VK/ien n is even 

P,'?G'P2(n) 

VF/ien zs odd, E{oi^i_-^ ■ ■ ■ Oi,j_J = 0. 

Corollary 10. Let O be a d x d Haar distributed orthogonal matrix 
and m a non-zero integer. Then 

lim E(tr(0™)) = 0. 

d—>ca 

Proof. Let 7 G S'^ be the permutation with the one cycle (1,2,3,..., 
m). If m is odd then E(Tr(0'^)) = 0. So suppose that m is even. First 
let us consider 

d 

E(Tr(0-)) = ^iom-,^, ■ ■ ■ o^„^,J 

n,...,im=l 

= E E (Wg(p),g)W' 

fcl ; ■ • • T^m 

where 27 is the m-tuple . . . , Now 6^^ = ^lyg^-i- Thus 

Sp6^^ = 1 only when i is constant on the blocks of p V 75'7~^. Hence 

E(Tr(0'")) = Y (Wg(p),g)rf#(^'^^«^"'). 
p,geT'2(ni) 

Thus E(Tr(0'")) = 0(d-'"+#(P^«)+#(pV'^9'^"')). But -m + #(p V g) + 
#(P V 7^7-^) < 0. Hence lim^^oo E(tr(0")) = 0. □ 

Notation 11. Let 7 G S'„ be a permutation of [n] but, as in Notation 
|3| considered as a permutation of [±n] by setting 7(— fc) = —k for 
1 < k < n. Given e G and p,q & V2{n) we consider the pairing of 
[±n] given by p g = {''y5)~^5^p5q55^{j5) of [±n]. By Lemma [s] there 
is a permutation vrp.,,^ G S'^ and rjp.^q G such that 

d 

ii,i_i,...,in,i-n=l 
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Note that p is a pairing of [n], 5q5 is a pairing of [— n] and so p5q5 is 
a pairing of [±n]. If we adopt the notation 7_ = then {p q)5 = 
'yZ^Sf^qSpS^'j. Recall from the proof of Lemma [s] that TCp.^q was obtained 
by writing (p q)S as a product of cycles and taking one cycle of each 
pair {c, c'}. After this choice has been made rjp.^q records the position 
of the minus signs. 

Proposition 12. Let O be a Haar distributed dx d random orthogonal 
matrix and {Yi, . . . , Yn} d x d random matrices which are independent 
from O and whose entries have moments of all orders. Let 7 G Sn, 
e G Z2 and suppose d > n. 



E(Tr^(0^^yi,...,0^"F„)) 
= Yl (Wg(p),g)E(Tr(.^.^„,^.^,)(yi,--- ,y„)) 
p,ge'P2(n) 

Proof. 

E(Tr^(O^^Fi---0^"r„)) 

Now for notational convenience let e{k) = e\k\k and let Ik = je{k), then 
4u-. = «M-.- Thus 

■ ■ ■ J = EKz., ■ ■ ■ ow_ J = Yl (Wg(p),g)5;M, (5) 

p,q€:'P2{n) 

where 6l:„, = 1 if / = / o p6q6. Also y^''^ , = y\^^ , . Hence we 
have 

E(Tr^(0^^ri---0^"r„)) 

p,q£'P2{n) li,...,l-ri 
l=lop5q5 

Let i = I o e-f6. Then ii = /.^(i), 2_i = . . . , i„ = /_e(„), i-n = 
/e7(n)- Thus as p -^q = 5'~^~^5^p5q55^'~^5 we have 

l=lop5q6 i=iop-eq 
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So 

E(Tr^(O^^Fi---0^"K)) 



= (Wg(p),g)E(Tr(.^.^,,,^.,^)(yi,...,F„)). 

p,ge'P2(") 

□ 

We shall need a special case of this result in section [9j Let us say 
that a permutation vr is parity preserving if for all k, TT{k) and A; have 
the same parity. 

Lemma 13. Let ni,n2, ■ ■ ■ ,rir be even positive integers and n = ni + 
■ ■ ■ + rir. Let 'y = (1,2, . . . ,ni)(ni + 1, . . . ,ni + 722) ■ ■ ■ (ni + ■ ■ ■ + 
Ur-i + 1, . . . , rii + ■ ■ ■ + Ur) G Sn- Suppose that e E Z2 is such that 
ek = (—1)'^+"'^. Then for all p,q E 'P2{n), 7ip.,q is parity preserving. 

Proof. We first show that p -eQ = 6'~f^^6^p6q66^'~f6 is parity preserving. 
By direct computation we have the following. 

„ ,(ni, _ n _ / -7-'(9(2/c - 1)) q{2k - 1) is even, 
p-,q{^K ij-| g(2A;-l) g(2A; - 1) is odd; 



p-,q{-i2k-l)) 



-7 ^{q{2k)) q{2k) is even, 
q{2k) q{2k) is odd. 



Note that since 7 always reverses the parity of its argument, all four 
possible outcomes are odd. Thus p -eq takes odd numbers to odd 
numbers. Since p g is a permutation it must then take even numbers 
to even numbers. Indeed 



p q{2k) 



p{2k) p{2k) is even 
--f-\p{2k)) p(2A;)isodd 



„ n(-(oi,\\ - S PinW) PilW) is even 
p -e q[ [AK)) - I _^-i(p(^(2fc))) p(7(2A;)) is odd 

Now 6{k) = —k is parity preserving, thus so is {p q)S. Finally vr^.^g 
is obtained by choosing one representative of each pair {c,Sc~^6} of 
{p -£ q)6, and taking the absolute value of each entry. This means that 
each cycle will consist of integers of the same parity. Hence vr^.^g is 
parity preserving. □ 



We wish to extend the conclusion of Proposition 12 to case where 
some of the y s are not interleaved by orthogonal matrices. 
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Proposition 14. Let O be a Haar distributed dx d random orthogonal 
matrix and {Yi, . . . , Yn} d x d random matrices which are independent 
from O and whose entries have moments of all orders. Let 1 < m < n, 
7 G Sm, e G and suppose d>m. 



E(Tr^(0^^yi, . . . , 0^-y„) Tr(F„+i) ■ ■ ■ Tr(F„)) 



Proof. The proof is the same as for Proposition 12 except that we 
append the random variable Tr(Fm+i) • • • Tr(y„) to the right hand side 
of each expression. □ 



We now wish to extend the conclusion of Proposition [12] in another 
way, namely to the case of independent Haar distributed orthogonal 
matrices. Suppose {Oi, . . . , Og} are independent Haar distributed dxd 
orthogonal matrices, with the (i, j) entry of Ok denoted 0(^k)ij. We shall 
need a expression for E{o(^k^)i^i_^0(^k2)i2i-2 ' ' ' 0{k„)ini-n) extending that 
given in Theorem [9j 

Notation 15. Given an n-tuple {ii,i2, ■ ■ ■ ,in) of integers in [s] we let 
ker(i) be the partition of [n] such that v = is where r and s are in the 
same block of ker(2) and v 7^ "is when r and s are in different blocks of 
ker(i). 

Let U G V{n) be a partition of [n] and p G V2{n) be a pairing such 
that each pair of p lies in some block of lA. We shall denote this by 
p <U. If we write the blocks of U as {?7i, . . . , t/r}, then the pairs of p 
that lie in Ui form a pairing of Ui which we shall denote by p\Ui or just 
Pi when convenient. 

If we have a partition U and pairings p,q E V2{n) with p,q <U then 
we let 

Wg(W,p,g) = (Wg(pi),gi) ■■■ (Wg(p^),g^). 

Remark 16. Note that since Wg is not multiplicative, Wg(U,p,q) and 
(Wg(p), q) are different. However by Remarklslwe see that when p,q < 
Wthen Wg(W,p,g)-(Wg(p),g) = 0{d-''+*'-P^-^) as the leading terms 
in both expressions are the same. 

Lemma 17. Suppose {Oi, ... ,0s} are independent Haar distributed 
dxd orthogonal matrices. Let the {i,j) entry of Ok be denoted 0(^k)i,j- 
Given an n-tuple (fci, . . . , in [s\ then 

Ho{k,)t,i^^O(k2)i2i-2 ■ ■ ■ 0(k^)ir,i.^) = XI Wg(ker(fc),p,g)5;5g5. 

p,<?e'P2(") 

p,5<ker(fc) 
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Proof. We can write E{o(^ki)hi.iO(k2)i2i-2 ' ' ' 0{kn)ini-n) as a product of 
expectations, one for each block of ker(A;). For each block Uj of ker(A;) 

we get a factor Ep,.,g,.GP2{c/.)(Wgfe)' ^i)^w5%<5 ^^^^^ h is the restric- 
tion of i to the block Uj. Taking the product of these terms we get 

p,g<ker(fc) 

Proposition 18. Let {Oi, ... ,0s} be independent Haar distributed 
dxd orthogonal matrices and {Yi, . . . , 1^} dxd random matrices which 
are independent from {Oi, . . . , Og} and whose entries have moments of 
all orders. Let 7 G Sn, e G and suppose d > n. For each n-tuple 
{ki, . . . , kn) in [s] we have 



E(Tr,(0^;ri,...,0-F„)) 
= Wg(ker(/.),p,g)E(Tr(.^,^,,,^.^,)(ri,--- 



p,(7<ker(fc) 

Proof. The only point where the proof differs from the proof of Propo- 
sition [12] is in Equation [5} which we replace by 

Wo^;^\ . . ■ • ■ o%-\ . . ) 

= ^{o(^k^)hu^ ■ ■ ■ 0(k„)U-„) = Wg(ker(fc),p,g)5j,5g5. 

p,(j'<kor(fc) 

The remainder of the proof is unchanged. □ 

4. A Lemma on Spoke Diagrams 

At several points later on we shall wish to know that a given permu- 
tation represents a spoke diagram (see Figure [2]). Lemma 20 identifies 
standard spoke diagrams and Lemma [21] identifies reversed spoke dia- 
grams. 

Lemma 19. Suppose 'j & Sn is a permutation, p G 7^2 (^) pairing, 
and e E an assignment of signs, are such that TCp.^p is a pairing. Let 
(r, s) E p be a pair of p. 

i) If tr = -ts then {-f-^{r),-f{s)) G p, (7"^(r),s) G Tip.^p, and 

ii) If er = ts then (7~H^), 7"^(s)) e p, (7"^(^), 7"^^)) e -Kp.^p, 
and ^■y{r) = ^fis) ■ 
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Proof, (i) Let us suppose that tr = —eg- Since (r, s) E p and = — 
we have 

(r, -s), (-r,s) e 

Since TTp.^p is a pairing, (p -6^)5 is also a pairing — recall that p -eP — 
{'y6)~^SepSp66e{'yS). Also 

(p ■,p)5ir\r)) = (75)-^ap5p55,)(75)5(7-'(r)) = s. 

Thus (7~^(r),s) G (p ■eP)^, because {p ■ep)S is a pairing. Since both 
7~-'-(r),s e [n] we have that {'y~^{r),s) e vr^.^p. Moreover (7~-'-(r), 
s) e TTp.^p and so (p = 7~'^(0- Unwinding this equation we 

have 

p5p5{e^^s)l{s)) = -e^-i(^)7"^(r). 

Since pSp6, as a permutation, doesn't change the sign of its argu- 
ment, we have e^(^s) = ^£7-1^- Thus pSpS{j{s)) = ■j~^{r), and we 
are left with (7~^(r), 7(5)) is a cycle of p, (7^^(r),s) e vr^.^p, and 
e^(s) = — e^-i(r) as required. 

(m) Let us suppose that = e^. Since (r, s) e p and = we have 

(r,s), (-r, -s) e 

Since Tip.^p is also a pairing, (p ■ep)(5 is a pairing. Also 

(p ■.p)5(7-'(r)) = (75)-^(5,p5p(5<5,)(75)5(7-^(r)) = -i-\s). 

Thus (7~"^(r), — 7~"^(s)) is a pair of (p -e p)5. Thus (7"-'^(r), 7^^(s)) G 
TTp.^p. Moreover (p p)5(— 7~^(s)) = 7~^(r). Unwinding the equation 
(p "e p)5(— 7~"^(s)) = 7~^(r) wc have 

pSpS{-e^(s)'y{s)) = -e^-i(^)7-^(r). 

Since pSpS, as a permutation, doesn't change the sign of its argu- 
ment, we have e^-i(r) = 67-1(5). Thus p6p6{j^^{s)) = 7~^(r), and 
we are left with (7~^(?"), 7~^(s)) is a cycle of p, e^-i(^r) = ^7-1(3); and 
(7~^(r), 7~^(s)) G TTp.^p as claimed. 

□ 

Lemma 20. Let 7 be the permutation with the two cycles (1, . . . ,m) 
{m + 1, . . . ,m + n), let e G Z^"*"", and let p E V2{m -\- n) be a pairing 
such that 

i) p V 7 = Im+n, i-G- o-i least one of cycle of p connects the two 

cycles ofj; 

a) for some (r, s) & p we have = — e^; and 
Hi) TTp.^p is a pairing. 
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Then m = n, p and iTp.^p are standard spoke diagrams, and there is I, 
which we make take to be 'j~^{s) if we assume that 1 < r < m, such 
that 

a) every cycle of p is of the form (fc,7~^(/)) for 1 < k < m, and 

b) every cycle of Hp.^p is of the form {k,'y~^~^{l)) for 1 < k < m, 

c) and er = — for all (r, s) G p, 

d) r]k = 1 for all k. 

Proof. Let (r, s) G p, i.e. {r,_s) is a cycle of p, and suppose = — e^. By 



using induction on Lemma 19 we know that for all k, (7 ^ (r) , ■y'' (s)) G 
p, e^-k(j.) = — e^fc(£2, and {'Y^'^{r),'y^'^{s)) G Hp.^p- Recall that in the 



proof of Lemma 19 (z) we showed that (7~^(r),s) G {p ■eP)S- This 
implied that (7"^),s) G vr^.^p and that r]^-i(r) = Vs = ^- By our 
induction argument we have that rj^ = 1 for all k. 

By assumption, p has at least one pair (r, s) that connects the cycles 
of 7; and so by what we have just observed, all cycles of p connect the 
two cycles of 7. This implies m = n, and all cycles of p are of the form 
(/c, 7~'^(/)), where / = 7^~^(s), assuming 7~''(r) = m. Moreover, both 
p and vTp.^p are spoke diagrams, i.e. non-crossing annular pairings of an 
(m, m)-annulus with all pairs connecting the two circles; see Figure [2] 

□ 

Lemma 21. Let 7 be the permutation with the two cycles (1, . . . , m) 
(m + 1, . . . , m + n), let e & Z^"*""^, and let p E V2{rn + n) be a pairing 
such that 

p V 7 = Im+n, i-G. at least one of cycle of p connects the two 
cycles of'-y; 
a) for some (r, s) E p we have er = e^; and 
Hi) TTp.^p is a pairing. 

Then m = n, p and TCp.^p are reversed spoke diagrams, and there is I, 
which we make take to be 7~''(s) if we assume that 1 < r < m, such 
that 

a) every cycle of p is of the form {k,'~f''{l)) for 1 < k < m, and 

b) every cycle of Tip. ^p is of the form {k,'~f^{l)) for 1 < k < m, 

c) and e,. = for all (r, s) G p, 

d) i]k = for all k G [m]. 

Proof. Let (r, s) G p, i.e. (r, s) is a cycle of p, and suppose e,. = e^. By 



using induction on Lemma 19 we know that for all k, (7~'^(r), 7^'^(s)) G 
p, e^-fc(r) = ^-y-krs), and {'y^{r),'y~''{s)) G VTp.^p. Recall that in the 
proof of Lemma 19 (ii) we showed that (7~"'^('"), — 7~^(s)) G {p ■eP)S- 
This implied that {j^^{r),'j~^{s)) G Hp.^p and that ri^--i-{r) = —1. By 
our induction argument we have that 77^ = —1 for all k G [m]. 
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By assumption, p has at least one pair (r, s) that connects the cycles 
of 7; and so by what we have just observed, all cycles of p connect the 
two cycles of 7. This implies m = n, and all cycles of p are of the form 
(/c,7'^(/)), where / = 7~'~(s), assuming 7~^(r) = m. Moreover, both p 
and vTp.^p are spoke diagrams, i.e. non-crossing annular pairings of an 
(m, m)-annulus with all pairs connecting the two circles; see Figure [2] 

□ 

Corollary 22. Let 7 G Sn be a permutation, p G V2{n) a pairing, and 
e G Z2 an assignment of signs. Suppose that iTp.^p is a pairing then 
each block of pV contains at most two cycles of'y. 



Proof. We saw in Lemma 19 that when p connects a pair of cycles of 7 
these two cycles form a spoke diagram. So a block of p V 7 can contain 
at most two cycles of 7. □ 

5. Real Second Order Freeness 

Let us recall the definition of real second order freeness from Re- 
delmeier jR^ §1]. We begin with the concept of a real second order 
non-commutative probability space. 

Definition 23. Let A be an algebra over C and with an anti-auto- 
morphism of order 2 denoted by a i— a*. Suppose that : ^ — )■ C is a 
tracial state and (y92 : x -A C is a bi-trace, i.e. (p2 is bilinear and 
tracial in each entry. Moreover we assume that v^2(l; 0.) = ^{O'l 1) = 0, 
y9(a*) = '^{a) and v^2(fl*, b) = ip2{0', &*) = f2{0', b) for all a, 6 G Then 
(^, <y9, </92, t) is a real second order non- commutative probability space. 

Notation 24. Let unital subalgebras Ai, . . . , Aj- d Ahe given. 

i) We say that a tuple (ai, . . . , a„) of elements from A is cyclically 
alternating if, for each i, there is G {l,...,r} such that 
tti G Aj. and, if n > 2, we have jk 7^ jk+i for all A; = 1, . . . , n. 
We count indices in a cyclic way modulo n, i.e., for k = n the 
equation above means jn 7^ ji- 
a) We say that a tuple ( ) of elements from A is centred 

if we have 

ip{ai) = for alH = 1, . . . , n. 

Definition 25. Let {A,(p,ip2,t) be a real second order non-commuta- 
tive probability space and suppose that we have unital subalgebras 
Ai, . . . , An that are invariant under a 1— )■ a*. We say that Ai, . . . , An 
are real free of second order if 

i) the subalgebras Ai, . . . , An are free with respect to ip; 
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Oi ai 




Figure 4. The terms on the right hand side of equation 
^ are sums over all spoke diagrams. In the diagram on 
the left the circles have the opposite orientation; we put 
the a's on on circle and the 6's on the other. This gives 
the first term on the right hand side of (|6|. In the circle 
on the right the two circles have the same orientation and 
we put '6*'s on the inside circle. This gives the second 
term on the right hand side of (|6]). 



a) for every Oi, . . . , G ^ and bi, . . . ,bn & A such that (oi, . . . , 
a^i) and (61, ... , 6„) are centred and cyclically alternating, we 
have 

a) ip2{ai ■ ■ ■ am, 61 ■■■&„) = 0, if m 7^ n or if m = n = 1 and 
ai and hi are from different subalgebras; 

b) for m = n > 1 we have, taking all indices modulo n 

n n y \ 

ip2{ai ■ ■ ■ anjbi ■ ■ ■ bn) = i Lp{aibk-i) + Lp{aib\_^) \ . (6) 

k=i i=i ^ ^ 



Notation 26. Let p G C[xi, . . . , x^, x^, . . . , x*] be a polynomial in the 
non-commuting variables {xi, . . . , Xs, x* , . . . , x*} and Ai, . . . , be (i x 
d matrices. By p{Ai, . . . , As) we mean the matrix obtained by replacing 
Xj by Ai and x\ by A\ in p. Similarly if {A, if, ip2, t) is a real second order 
non-commutative probability space then by . . . , a^) we mean the 
random variable in A obtained by replacing Xj by and x\ by a\. 

Remark 27. Expanding on the notation in equation ([3]) we define, for 
a permutation vr G 5"^ and Oi, . . . , a„ G .4., (^,^(^1, • • • , o„) as below. 

V9^(ai, . . . ,an) = J]^ v9(aii ■ ■ -aij, 
c=(n,...,ifc) 
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where the product is over all cycles c of vr and for each cycle c = 
(zi, . . . , ik) we get the factor (p{aij^, . . . , Oj^). This makes ip^ a n-linear 
functional. 

With this notation we can write equation (|6]) in a simpler way: 
ip2{ai---an,bi---bn) 

= X] V5vr(ai,---,an,&l,---,&n) 

7reSp+(n) 

+ XI </'^(ai,---,an,6l,...,&l), 

7re5p~(n) 

where, recall, Sp^{n) denotes the set of standard spoke diagrams and 
Sp~{n) denotes the set of standard spoke diagrams. 

We shall need to use the associativity of real second order freeness. 
Let us recall how this works in the first order case jvDNj . Suppose that 
we have unital subalgebras Ai, . . . ,As C A which are free with respect 
to if. Moreover that for each 1 < z < s we have unital subalgebras 
Bi^i, . . . , Bi^ti C Ai which are free with respect to ip. Then by [vdn; 
Prop. 2.5.5 (m)] the subalgebras Bi^i, . . . Bg^ts ^ ^ are free with respect 
to (p. We shall prove the real second order version of this. In |mss 
Remark 2.7] the second order version of jvDNj was left as an exercise for 
the reader, now we shall provide a solution. We begin with a lemma. 

Lemma 28. Let Ai, . . . ,As C A be unital subalgebras which are free 
with respect to ip. Suppose that ai, . . . , a^, 6i, . . . , 6„ G ^ are such that 

o (f{ai) = f{bj) = for all i and j ; 

o ai e Ak, and hj^ k2 ■ ■ ■ k^; 

o bj G Ai^ and h ^ h ^ ■■■ ^ In- 
Then for m ^ n, (y9(ai ■ ■ ■ flm^n ■ ■ ■ &i) = and for m = n 

m 

ip{ai ■ ■ ■ ambm bl) = Y\ ^{aA)- 

i=l 

Proof. Let us begin by showing that 

V9(ai ■ ■ ■ ajjn ■■■bl) = (p{ambn)<-p{ai ■ ■ ■ cim-ibn-i ■ ■■bl). 

First suppose that km 7^ In- Then both ip{ai ■ ■ ■ ambn ■ ■ ■ bi) and 
(f{ambn) are by freeness. Thus both sides of the equation above are 0. 
Next suppose that km = In and write Qmbn = {ambn)° + ^{cLmbn)- Then 
ip{ai ■ ■ ■ am-i{ambn)°bn-i ■■■bl) = because km-i 7^ km = L L-i- 
Thus 

ip{ai ■ ■ ■ a„6i • ■ • 61) 
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= ip{ai ■ ■ ■ am-i{ambn)°bn-i ■■ - h) 
+ <f{ambn)<^{ai ■ ■ ■ am-ihn-i ■■■hi) 

= (p{ambn)^{ai ■ ■ ■ am-ibn-i ■■ ■bi). 

Now we conclude by induction. If m = n we get the formula we 
claimed. If m < then 

V9(ai ■ ■ ■ ambn ■■■bi) = (p{ambn) ■ ■ ■ (p{a^bn-m+l)v{bn-m " " " &l) = 

by the freeness of the b/s. The case when m > n is exactly the same. 

□ 

Proposition 29. Let Ai, . . . , As <Z A be t-invariant unital suhalgehras 
of A which are real second order free with respect to (yj, (^92). For each 
1 <i < s suppose we have t-invariant unital suhalgehras Bi^i . . . , Bi^t, C 
Ai which are real free of second order with respect to [ip, 1^2)- Then the 
suhalgehras Bi^i, . . . , Bs,ts C A are real free of second order with respect 
to {(p,(p2)- 

Proof. The proof of first order freeness is as in jvDNl Prop. 2.5.5 {Hi)]. 
So let us prove part (ii) of Definition 25 , Let ai, . . . , am, bi, . . . ,bn E A 
be such that 

o (p[ai) = ip{bj) = for all i and j; and 

o ai e Bk„u, and (A;i,ui) ^ {k2,U2) 7^ • ■ ■ 7^ {km,Um) 7^ {ki,ui); 
and 

o bj e Bi^^y^ and {h,vi) ^ {l2,V2) 7^ ■ ■ ■ 7^ {L^Vn) 7^ {h,Vi). 
We must show that for m = n > 2 

ip2{ai ■■■am,bi- ■■bm) 

7reSp"'"{m) 

'^n{0'l ■ ■ ■ a^n, hi' ■ ■ b^ 

) (7) 



E 

TTgSp (m) 



and is for m ^ n:, the case m = n = 1 is immediate. 

Note that adjacent a^'s are, by assumption, from different Bk^v^ 
but might be from the same Ad- So we group the a^'s according to 
which Ad contains them. Let mi, . . . ,mp be positive integers such 
that mi + ■■■ + nip = m and a^i+...+„^_j+i, . . . , a„,+...+m^ G Ad,, 
for 1 < i < p and di 7^ ^2 7^ ■ ■ ■ ^ dp ^ di. Then we let Ai = 
c^miH — hmi_i+i ■ ■ ■ c^miH — \-mi ^ '^di- Then ■ ■ ■ = Ai ■ ■ ■ Ap. 

We do exactly the same for the bj's. Namely we let tt-i, . . . , Ug be posi- 
tive integers such that niH \-nq = n and 6ni+-nj_i+i, • • • , &ni+-+nj e 
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for 1 < j < g and ei 7^ 62 7^ ■ ■ ■ 7^ Cg 7^ ei. We let Bj = 
bn+i+-+bj.i+i ■ ■ ■ bni+-nj ^ -Ae^ • Then hi - ■ ■bn = Bi - ■ ■ Bq. 
Note that by first order freeness 

V'(^j) = V'(cfmiH hmi_i+l ■ ■ ■ C^miH hmj ~ 0; 

since the i3j j's are first order free by jvDN^ Prop. 2.5.5 (m)]. Likewise 
¥,(5,) = 0. ' 

If p = g = 1 then we have ([T]) by the assumed second order freeness 
of . . . , Bi^t^. lip ^ q, then by the assumed second order freeness of 
Ai, . . . ,As we have V52(ai ■ ■ ■ flm, bi - ■ - hn) = 0, thus the left hand side 
of is 0. 

Let us consider the right hand side of ([T]). If m 7^ n then the right 
hand side is 0. So let us suppose that m = n. Let us first consider the 
term involving Sp^{m). For vr G Sp^{m) and (pT^iai, . . . , &i, • • • , bn) 
7^ we must have (/cj, ii) = {Ij, Vj) for all e tt. This means tt gives 
a bijection between the Ai^s which contain the Oj's and the Aj^s which 
contain the fo/s. So in particular p = q, which is impossible. Likewise if 
vr G Sp^{m) then we have a bijection between the AiS containing the 
aj's and the Aj's containing the 6*'s. So again we would have p = q. 

Now let us suppose that p = q > 2. By the assumed real second 
order freeness of ^1, . . . , we have 

ip{ai ■ ■ ■am,bi - ■ - bn) = ip2{Ai ■■■Ap,Bi--- Bp) 

= ^ (p^{Ai, . . . , Ap, Bi, . . . , Bp) 

TT£Sp+{p) 

+ ^AAu...,Ap,Bl,...,Bl). (8) 

n£Sp~{p) 

For TT G Sp^{p) and {i,j) G vr we have by Lemma 
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when rrii = rij 



ip{AiBj) — ip{ami+-m,^i+lbni+-+nj) ' ' ' V'(Omi+---mi&ni+--+nj_i+l) 

and when rrii 7^ rij. Thus for this vr, assuming = nj for all 
{i,j) G 71, we have 

V9^(y4i, . . . , Ap, Bi, . . . Bp) = (pji{ai, . . ., ajn, bi, . . . , bm) 

where vf G Sp^{m) is the spoke diagram obtained by matching up 
rrii + ■ ■ ■ + + k with rii + ■ ■ ■ rij — k + 1. 

For TT G Sp~{p) and j) G vr we have by Lemma 28, when rrii = % 

ip{AiB^j) = V3(arrM+-m,_i+l&^,+...+n,_i+l) " ' ' ^p{ami+-m,bm+-+n,) 
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and when 7^ rij. Thus for this tt, assuming = Uj for all 
G vr, we have 

V9^(Ai, . . . , Ap, . . . fi*) = v^s (cii, . . . , a„, 6*1, . . . , 6^) 

where tt G Sp^{m) is the spoke diagram obtained by matching up 
rrii + ■ ■ ■ + + A; with rii + ■ ■ ■ nj_i + /c. 

If we let TT run over Sp^{m) on the right hand side of ([8|, the corre- 
sponding tt's will not exhaust all tt's on the right hand side of ([T]), but 
the ones that are missed are such that ^^{cii, . . . , Om, &i, . . . , &-m) = 0, 
by the first order freeness of the AiS. Similarly for the tt's in Sp^{m) 
on the right hand side of (|8]). We thus have 

ip^{Ai,. . .,Ap,Bi,. . . ,Bp) 

+ ^ ^Mi,...,Ap,B\,...,Bl) 

n£Sp~ (p) 
TT^Sp'^ (m) 

+ X] ipT,{ai - ■ ■ am,b\ - ■ -b^^). 

-iT^Sp~ (m) 

This combined with ([s]) proves ([T]). □ 

Definition 30. Suppose for each d we have random matrices {A^ i, . . . , 
^d.s}- We say that the ensemble has a real second order limit dis- 
tribution if there is a real second order non-commutative probability 
space {A,ip,ip2-,t) and G A such that for all polynomials 

Pi,P2,P3, - ■ ■ in the non-commuting variables {xi, . . . } we 

have 

i) limrf_^oo E(tr(pi(Ad,i, . . . , Ad,s))) = '^{Piiai, a^)); 

lim cov(Tr(pi(Arf,i, . . . , A^^s)), 
''^ Tr(p2(A,,i,...,A,,,))) 

Hi) for all r > 3 

lim fc,(Tr(pi(Arf,i,...,v4rf,,) ),..., Tr(p^(v4rf,i,v4^i,..., Ad,,))) = 0. 

Remark 31. The third condition is only needed to ensure the conver- 
gence of fluctuations of mixed moments. In fact boundedness would be 
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enough. For many ensembles of matrices the r cumulant vanishes on 
the order of for example the ensembles discussed in [rIJ [R2]. For 
deterministic matrices the higher cumulants of traces are 0. Moreover 
a close reading of our proof shows that if one starts with an ensemble 
{Ajjjwith kr between o(l) and 0(1) for r > 3, the mixed cumulants of 
A's and O's for r > 3 would have the same order as {Aj},. 

Remark 32. Suppose we have for each d, random matrices {A^^i, . . . , 
Ad,s}, a non-commutative probability space {A,f), and Oil, ... 5 d-n ^ 
A such that for every polynomial p in the non-commuting variables 
Xi, . . . ,Xs,x\, . . . ,xl we have 

lim tr(p(y4rf,i, . . . , Ad,n)) = • • • , an)) 

then we say that the matrices {A^^i, . . . ,Ad^n} have the limit joint t- 
distribution given by 

Definition 33. Let {A^^i, Ad,r}d and {Bd,i. ■■ Bd,s}d be two en- 
sembles of random matrices such that . . . , A^^r, • • • , Bd s}d 
has a real second order limit distribution given by {oi, . . . ,Os,bi, . . . , 
bs} in the real second order non-commutative probability space {A, (p, 
(p2, t)- If the two unital subalgebras Ai = alg(l, oi, . . . , Or, a\, . . . , a*) 
and A2 = alg(l, bi, . . . ,bs,b\, . . . ,bl) are real free of second order then 
we say that the two ensembles . . . , ^d,r}d and {-Bd,i. • • • , Bd,s}d 
are asymptotically real free of second order. 

6. First Order Freeness of Haar Orthogonal 
AND Independent Matrices 

To show that a family oi d x d random matrices {Ai, . . . ,As}d and 
an independent family of orthogonal matrices {Od}d are asymptoti- 
cally real free of second order, we must first demonstrate that they are 
asymptotically free of first order, or asymptotically free in the sense of 
Voiculescu jvDN^ §2.5]. 

For this we must show that given polynomials {pi, . . . in O and 
O^^ such that E(tr(pi(0, O^^))) = and random matrices {Ai,..., 
As] with E(tr(A)) = 0, then 

lim E(tr(pi(0,0"^)Ai---p„(0,0-i)A)) =0 

d-^00 

provided that the entries of the Ad/s are independent from those of the 
O's and the {^4^1, . . . , Ad^n} have a real second order limit distribution. 
For this it suffices to prove that 

lim E(tr(0"'Mi ■ ■ ■ 0™M,)) = 
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for any sequence of non-zero integers mi, . . . , and {Ai, . . . , Ag} as 
above. 

Notation 34. Let tt G be a permutation and U G V{n) be a 
partition such that each cycle of vr hes in some block of U. We denote 
this relation by tt < W. Let Ai, . . . , An he d x d random matrices and 
write, as in equation (|3|, 

Let the blocks of U be {[/i, . . . , ?7fc} and let vTj be the product of 
cycles of vr that lie in Ui. If c = is a cycle of vr, let 

Ttc{Ai, . . . ,An) = TT{Ai^ ■ ■ ■ Ai^) . If Hi = ci---Cfc, as a product of 
cycles, let Tr^,(Ai, • • • , A„) = Hi Tr^^l^i, • • • , ^n)- Next let 

Ew(Tr,(Ai,...,A„)) = nE(Tr..(^i,---,^n)). (9) 
Finally for r] = {rji, r]2, . . . , rjn) G and vr G S'„, let 

To make this clear let us give an example. Let n = 6, vr = (1)(2,4)(3) 
andW = {(1,3), (2,4)}. Then 

E^,(Tr^(Ai, ^2, As, A4)) = E(Tr(yli) Tr(A3)) E{Tt{A2A,)). 

We shall also need to work with the normalized trace tr = d~^ Tr. We 
let tr^(Ai, ...,An)= TtMi, • • • , A„). 

If W G P(n) and vr < W, in the sense above, then we let 

kuiTiMu . . . , An)) = J2 m{V,l()Ev{TT^AAi,...,An)). (10) 

VeP(n) 
7r<V<W 

Then by Mobius inversion we have 

EuiT:T^XAu...,An))= ^v(Tr^(Ai,...,A„)). (11) 

VeP(n) 
7r<V<W 

Remark 35. In what follows, for an ensemble of dxd matrices {Ai, . . . , 
As}d, will suppress the dependency of Ai on d and just denote it by 
Ai. Moreover the (2,j)-entry of Ak will be denoted a[j\ This should 
not cause any confusion as at each stage of the discussion we shall only 
be multiplying matrices of the same size. Likewise for an ensemble 
of random orthogonal orthogonal matrices {Oii}d, we shall drop the 
dependence on d from the notation. 
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Theorem 36. Let for each d, {Ai, . . . , An} be a ensemble of centred 
d X d random matrices that have a real second order limit distribution, 
O a Haar distributed random d x d orthogonal matrix, and mi, . . . , m„ 
be non-zero integers. Then 

lim E(tr(0"'Mi ■ ■ ■ 0™"A„)) = 0. 



Proof. In order to be able to use the resuh of Proposition [12} with 7 = 
(1, 2, 3. ... , n), we have to reduce it to the case of each rui being either 1 
or —1. We can achieve this by inserting an identity matrix, /, between 
any two adjacent O's or adjacent 0~^'s. For example O^AiO~^A2 
would become OIOAiO~^A2. So with this change we must show that, 
whenever we have ei, . . . , e„ G { — 1, 1} and random matrices Ai, . . . ,An 
with a limit joint t-distribution such that for each i, either Ai is centred, 
i.e. E(tr(Aj)) = 0, or Ai = I and = e^(j), then 

lim E(tr(0'^Ai ■ ■ ■ 0'"A„)) = 0. 



By Proposition [12] 

E(Tr(O^^Ai,...,O^M0) 
= E (Wg(p),g)E(Tr(.^.^^,,^,^,)(^,...,AO). 

Let us recall the construction of TTp.^q. We write the permutation 
(p -e q)S, which is the product of two pairings, as a product of cycles. 
We showed that the cycles always occur in pairs of the form {c, c'}, 
where c' = 6c~^6. From each pair we choose one, and then from this we 
obtained a cycle of TTp.^g by deleting any minus signs. The minus signs 
that are deleted are recorded in rjp.^g. So let us consider the singletons 
of TTp.^q. If (fc) is a singleton of TCp.^q, then {p q)5 will have the two 
singletons {k){—k) and thus (/c, —k) will be a cycle of {p -eq) and hence 
(— (5e(A;), deipfik))) will be a cycle of p5q5. The cycles of p5q5 are either 
cycles of p, consisting of pairs of positive numbers, or cycles of 5q5, 
consisting of pairs of negative numbers. Thus if (k) is a singleton of 
TTp.^g then we must have = —€.y(k), and hence A^ is a centred matrix. 

Now consider the expansion 

E(Tr(O^^A,...,O^M0) 
= E (Wg(p),g)E(Tr(.^.^^,,^,^,)(Ai,...,AO). 

P>i3eP2(n) 

We have 
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We must next find a upper bound for tlie order of 

E(Tr(^p.^^,^^.^^)(Ai, . . . , An)) = /cw(Tr(^^.^^,^^.^^)(Ai, . . . , A^)). 

Since {Ai, . . . , An} has a real second order limit distribution we have 
that 

fcw(Tr(.,.,„„,.,,)(^i,...,An)) = 0(rf'') 

where u is the number of blocks of U that contain a single cycle of vr. 
If U has a singleton (k) then vr, too, will have a singleton (/c) and then 
Ak will be centred so ku(TY(^T,^ ^^{Ai, . . . , A^)) will have a factor 
E(Tr(A,)) = 0, hence ku{Ti^^/^^^^^,.l){A^, A^)) = 0. 

Thus u < < n/2 and so — + V g) + m < 0, thus 

(Wg(p), g) E(Tr(.^.^,,,^.^^)(Ai, . . . , A„)) = 0(1). 

Thus 

E(Tr(O^Mi,...,O^M„)) = 0(l) 

and hence 

lim E(tr(0'^Ai, . . . , 0'"An)) = 0. 

□ 

Corollary 37. Lei {Ai, . . . , be d x d random matrices whose 

entries have moments of all orders, O a Haar distributed random dx d 
orthogonal matrix, independent from {Ai, . . . , An+i}, and ei, . . . , e„ G 
Z2. Suppose that for each 1 < i < n we have that either E(Tr(y4j)) = 
or Ai = I and ej = e^+i (using e^+i = ^i), and E(Tr(A„_|_i)) = 0. Then 

E(Tr(O^^Ai---0^"A„)) = 0(l), 

in fact 

E(Tr(O^Mi---0^"A„)) 

= d-^l' K,.jT^^,..,,,^,^A^„...,An)) + 0{d-') (12) 

where the sum is over all p's such that TTp.^p is a pairing and 
E(Tr(O^^Ai ■ ■ ■ O'-An) Tr(A„+i)) = Oid''). 

Proof. The first claim is just the second last equation of the proof of 
Theorem |36] Recall that when we expand into cumulants 

E(Tr(^,.,,,r,,.,,)(A,...,^n))= J2 ku{A,,...,An) 

and let u be the number of blocks of U that contain a single cycle of 
T^P-eq have —n + \J q) + u < with equality only when p = q 
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and n = n/2, i.e. U = iTp.^p and Hp.^p is a pairing. This estabhshes the 
second claim. 

By Proposition [M] we have 

E(Tr(O^Mi---0^"A„)Tr(A„+i)) 
= E<Wg(p), g) E(Tr(.^.^,,,^.^^)(Ai, . . . , A„) Tr(A„+i)). 

For the moment let us fix p, g G V2{n) and let vf G Sn+i be the permu- 
tation which fixes n+1 and whose restriction to [n] is T^p.^q- Likewise let 
fl\[n] = Vp-.q and fjn+i = 1. Then E(Tr(^^.^^,^^.^^)(Ai, . . . , A„) Tr(A„+i)) 
= E(TY(^;^^fj){Ai, . . . , A^+i)) Then we expand as above 

E(Tr(^f,i^)(v4i,. . . ,v4„+i)) = ^ A;iY(Tr(^,i^)(v4i, . . . ,A„+i)). 

Suppose U G P(n + 1) is such that n < U and ki((TT(^^^fi){Ai, . . . , 
An+i)) 7^ 0. Then 

A;w(Tr(^,^)(Ai,...,A„+i)) = OK) 

where m is the number of blocks of U that contain only one cycle of vr. 
Since, by assumption, E(Tr(^„+i)) = 0, the last cycle of vr cannot be 
in a block of U on its own (otherwise ku = 0); thus u < — 1. As 



in the proof of Theorem 36, < n/2 and as the cycle {n + 1) 

cannot be on its own we have < n/2. So u < n/2 — 1. Thus 

—n + ^{p V q) + u < —1 and so 

(Wg(p), q)ku{TT(^^,^){A,, . . . , /l„+0) = Oid-'). 
Since this holds for every U we have 

(Wg(p), q) E(Tr(^,^)(Ai, . . . , = Oid''). 

Since this in turn holds for every p and q we have 

E(Tr(0^^ A ■ ■ ■ 0^"A„) Tr(A„+i)) = 0(rf-^). 

□ 

7. Fluctuation Moments of Haar Orthogonal 
AND Independent Random Matrices 

Our next step is to show that the limit distribution of Haar dis- 
tributed orthogonal matrices and an independent ensemble of random 
matrices with a real second order limit distribution satisfies part {ii) 



(b) of Definition 25 Fix positive integers m and n and let 7 be the 



permutation with the two cycles (1, . . . , m){m + 1, . . . , m + n). 
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Theorem 38. Let {Ai, . . . , Am} and {Bi, . . . , Bn} be a ensemble of 
centred d x d matrices that have a real second order limit distributions 
given by (ai, . . . , am) and (61, . . . , respectively, in a real second or- 
der non- commutative probability space {A, (f, f2, t), and O a Haar dis- 
tributed random dx d orthogonal matrix, and ki, . . . ,km,h, ■ ■ ■ ,ln non- 
zero integers. Suppose that the entries of {Ai, . . . , Am, Bi, . . . , Bn} are 
independent from those ofO. Then 

lim cov(Tr(0'=Mi • • ■ 0'^'"A„), Ti{0^'Bi ■ ■ ■ O^-B^)) 

d—>oo 

exists and equals when m ^ n, and when m = n > 2, equals 



m f m m 
r=l ^ i=l i=l 



Jv.(o^-'-0 • (13) 



where the indices of the b's and I's are taken modulo m. 

Proof. We begin by noting that by Theorem [9} m + n must be even, 
otherwise the limit of the covariances is 0. In order to apply Proposition 



12] to the expression 

cov(Tr(0'^^Ai ■ ■ ■ O'^^ Am), Tr(0'^Si ■ ■ • 0'"5„)) 

we have to reduce it to the case where all /c's and Vs are either 1 or 
— 1. So let us consider the term ip{aibr-i)(p{o''^^^'—(^-^^) of expression 
(13). In order for this to be non-zero we must have fcj + /r-(i-i) = 
0. So when we perform the reduction used in the proof of Theo- 
rem 36 we replace 0'^% supposing ki > 0, with olo---olo and 0'-'—^+^ 
with o~^lo~^ ■ ■ ■ o~^lo^^ the factor (y9(o'^*"'''''~*+i) = 1 gets replaced by 
ip{oo^^)ip{ll)ip{oo^^) ■ ■ ■ ip{oo~^)ip{ll)(p{oo^^) = 1. Likewise with the 
factor y9(o^'~'''+'). Thus without loss of generality we can assume that 
ki . . . , kmh, ■ ■ ■ ,ln ^ !}• this case we must show that 

lim cov(Tr(O^Mi ■ ■ ■ 0^™A„), Tr(0^™+i5i • ■ ■ 0^'"+"5„)) 
exists and equals when m ^ n and when m = n equals 

r=l 1=1 i=l 

where the 7 in the index of the second e in 5^ ^ , , is the permu- 
tation with cycle decomposition (1, . . . , m)(m + 1, . . . , 2m). 
By Proposition [T2] 



E(Tr(0'Mi ■ ■ ■ O'-'Am) Tr(0''"+^5i ■ • • O'-'+^Bn)) 
= Yl (Wg(p), q) E(Tr(.^.^„,^.^,)(Ai, . . . , B^)), 

p,q£P2iin+n) 
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and 

E{Tt{0''Ai ■ ■ ■ O'-'A^)) E(Tr(0^™+^Si ■ ■ ■ O'-'+^Bn)) 
= E Wg(7,p,g)E,(Tr.^,^,(i^5'')). 

p,q£'P2{m+n) 

p,q<i 

— * — * 

To simplify the notation we let Tt^^.^^{A'^, B'') = Tr(^p.^^,^p,^^)(Ai, . . . , 
Bn). Thus 

cov(Tr(0'Mi • ■ ■ O'-'Am), Tt{0'^'+'Bi ■ ■ ■ O^^+^Bn)) 
= Yl (Wg(p),g)E(Tr.^.^,(1^5'')) 

p,q£'P2{m+n) 

- Yl Wg(7,p,g)E,(Tr.^,^^(l^S'')) 



p,q€.'P2{rn+n) 

p,q<i 



Y {Wg{p),q)E{TT^^,JA\B'^)) 



P,gGP2(ni+n) 
pVgV7=lm+n 



+ Yl {(Wg(p),g)-Wg(7,p,g)}E(Tr.^.^^(l^E^)) 



(15) 



(16) 



p,qGV2(rn+n) 

p,q<i 



+ ^Wg(7,p,g){ E{Tt^^,JA\B^)) - E,{Tt^^,JA\B^))}. (17) 



p,q&'P2{m+n) 

p,q<i 



We shall show that the first term (|15j) converges to 

m f m m 

r=l i=l i=l 



7* (m+r) 



and the second (16) and third term (17) converge to 0. 

We first consider expression (15), and show that this has the limit 
we have claimed. Let us find the order of E(Tr^p.^^(y4^, -B^)); to do this 
we have to rewrite this expectation in terms of cumulants so that we 
can use our assumptions about the A's and -B's having a real second 
order limit distribution. If we consider VTp.^g a partition of [m + n] then 
by equation (11) we have 



E(Tr(.,.,„,,.,,)(A,...,i?n)) 
= Y ^w(Tr(^^,^^,^^.^^)(Ai,...,5„)). 



(18) 



U>TT„.,g 
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Supposed G V{rn + n) and W > TTp.^g. If W has a singleton (A;), then (A;) 
is also a singleton of T^p.^q. As in the proof of Theorem 36, this implies 



that Ak (or Bk-m ii k > m) is centred, and thus, A;w(Tr^p.^^(A'', S'')) = 
0. Thus we only have to consider Ws with no singletons. Hence < 
(m+n)/2. Suppose ?7 is a block of U which contains two or more cycles 



of TCp.^q] the corresponding factor in Equation (18) is a second or higher 
cumulant of traces, which converge by our assumption that the A's and 
S's have a real second order limit distribution. Hence these factors will 
be of order 0{d^). Each block of U which contains only one cycle of 
TTp.^q will be of order 0{d). Hence ku{TTnp.^M\ B"^)) = 0(rf") where u 
is the number of blocks of U which contain only one cycle of iip.^q- As 

u < #(W) < {m + n)/2, 

we have A;w(Tr^^.^,(A^, 5'')) = 0(rf(™+")/2) and the order (m + n)/2 can 
only be achieved when u = (m + n)/2, which implies that Hp-^q = U, as 
partitions, and no cycle of iTp.^q is a singleton, because no block oiU is 
a singleton. If jj^ij^p.^q) = u = {m + n)/2 and T^p.^q has no singletons; 
TTp.^g must be a pairing. Combining these conclusions we have 

E(Tr.^,^,(i^#'')) = 0(rf('"+")/2-l) 
unless p = q and Hp.^q is a pairing, in which case 

= E.^.^,(Tr.^.^^(1^5'')) + 0(rf("+")/2-l). (19) 
Using our usual bound on the order of Wg, namely 
(Wg(p),g) = 0(rf-(™+")+#(f'''')), 

we thus have 

{Wg{p),q)E{TT^^,JA\B^)) = 0{d-') 
unless p = q and Hp.^q is a pairing, in which case 
{Wgip),q)EiTT^^,JA^,B^)) 
= E^^,JtT^^,JA\B^')) + 0{d~'). 



Thus 



J2 {Wg{p),q)E{TT^^,JA\W)) 



P,gS:'P2(m+n) 
pVqV'y=lm+n 



E ^^.■J^'^..M'^B')) + 0{d-') (20) 
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where the second sum runs over all p such that pM = Im+n and VTp.^p 



is a pairing. To find the limit as — )■ cxd we use Lemmas 20 and 21 



First suppose that there is {u^v) G p such that e„ = —t^. Then by 



Lemma 20 we have m = n, every cycle of p connects the two cycles 
of 7, and = —ej for all G p. Then for some r G [m] we have 

(m — 1, m + r) G p. Again by Lemma 20 we have for all k G [m] 

o (A;,7-'=(m + r)) G TTp.^p, 
o (/c, 7~'^'*"^(m + r)) G p, 
o r/fc = 1. 



Thus efc 



"^7 '°+'-(m+r) 



and 



k=l 

which converges to 



efei-e -fc+i 



(m + r) 



fc=l 



as (i — )■ cxD. 

Next suppose that there is {u,v) G p such that e„ = e^,. Then by 



Lemma 21 we have m = n, every cycle of p connects the two cycles 
of 7, and = e^- for all {i,j) G p. Then for some r G [m] we have 
{m — l,m + r) G p. As in Lemma 21 , let / = 7~™'"'"^(m + r) = 7''(2m). 
Then 7*^(/) = 7''(m + fc), for k G [m]. Hence by Lemma 21 we have for 
all k G [m] 

o {k,Yi'm + k)) G TTp.^p, 
o (fc, 7^(m + A;)) G p, 
O = -1. 

Thus efc = e^fe(m+r)- 



E.,..,(tr(.,.^„,,.^,)(Ai,...,i?„)) = Wn^MkBUk)^.,.,.,^^^, (22) 



fc=i 



which converges to 



'y'^ (m + r) 



fc=i 



as c? — )■ oo. Hence the expression (15) converges to 

m f m m 



7 * + -'-(m + r) 



r=l k=l 



k=l 
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To show that (16) and (17) vanish as (i oo we have to consider 
the order of Ej{Ttt,^,^^{A'^ , B^)) with p,q < As before we write this 
as a sum of cumulants 

U&Vim+n) 

Let u be the number of blocks of U that contain only one cycle of 
TTp.^g. If U has a singleton then the corresponding cumulant will be 
because the A's and -B's are centred; so we only consider Ws which 
have no singletons and thus < (m + n)/2. If we let u be the 

number of blocks of U that contain exactly one cycle of vr^.^g, then 
A;w(Trp.^g(l^S'')) = 0(c/") and u < < (m + n)/2. Recall that 

(Wg(p),g) - Wg(7,p,g) = 0((i-('"+'^)+#(P^^)-i) 
Since V g) < (m + /?.)/2 we have 

{ Wg(7, p, g) - Wg(7, p, g) } A;^.(Tr.,.,, (l^ 5")) 

Then summing over all Ws we have 

{Wg(7,p,g)-Wg(7,p,g)}E,(Tr.^.^^(1^5'')) = 0(c^-l). 



Thus the expression ( 16 ) 



{(Wg(p),g) - Wg(7,p,g)}E(Tr.^,^,(1^5'^)). 



P>Q<7 



converges to 0. 



Let us finally consider the expression (17) 



EWg(7,P,g){E(Tr.,.^,(/^5^))-E,(Tr.^.^,(1^5''))}. 

p,q&V2(m+n) 
P.g<7 

For each p,q < j we must show that 

Wg(7,p,g){E(Tr.^.^,(i'',5'')) -E,(Tr.^.^,(1^5''))} = 0{d''). 

So fix p, g < 7 and write Tyt,^,^^{A'^ , B'^) = Xi ■ ■ ■ XrX^+i ■ ■ ■ X^+s 
with Xi, . . . , Xr coming from the cycles of iTp.^q contained in [m] and 
Xr+i, . . . , Xr+s coming from the cycles of TTp.^q contained in [m + 1, m + 
n]. Then 

EiTT^^,JA\B^))-E,iTT^^,JA\B^)) = ^{X, ■ ■ -X^X.+i ■ ■ ■X,+,). 
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Using the formula of Leonov and Shiryaev jLS] 

k2{Xi ■ ■ ■ Xr, Xr+l ■ ■ ■ Xr+s) = k\;{Xi, ■ ■ ■ , Xr 

VVT=lr + s 



where r = {(1, . . . , r)(r + 1, . . . , r + s)}. Now let us use Notation 34 to 
write this as 

■ E <j <W (m+n) 

WV7=lm+n 

If W has a singleton (k) then T^p.^q will have a singleton {k). As in the 
proof of Theorem 36 this singleton must be a centred A^. (or -B^-m if 
k > m). So if U has a singleton we must have kK{TTTr^,^^{A^ , B^)) = 0. 
Thus we may assume that U has no singletons, so in particular < 
(m + n)/2. . As before let u be the number of blocks of U that contain 
exactly one cycle of vr^.^g. Then 

ku{TT^,.JA\B^)) = 0{dn. 

Now u < < (m + n)/2 and, as usual, 

Wg(7,p,g) = 0(rf-('"+")+#(P^^)). 

Thus 

Wg(7,p,g)A;w(Tr^,.^,(i^5'')) = 0(rf-('"+")+#(^'^^)+^). 

Since vr^.^g < 7 and W V 7 = Im+n we must have m < (m + n)/2, as 
equality would force Tip.^q =U as partitions. Thus — (m + n) + #(p V 
q) + u < —1. Hence 

Wg(7,P,g)A;^,(Tr.,.^,(1^5'')) = 0(^;-i). 

Summing over all Ws we have 

Wg(7,p,g){E(Tr.^.^^(I^S'')) -E,(Tr.^,^,(1^5''))} = 0{d-'). 

□ 

Remark 39. The proof of Theorem [38] actually proves a stronger state- 
ment than was claimed. Let Ai, . . . ,As is an ensemble of c? x d cen- 
tred random matrices where for 77 G { — 1, 1} we let A'' = A* for 
?7 = — 1 we let A'' = Aj for r] = 1. Suppose that for any monomi- 
als Wk = AJ;;^' ■ ■ ■ A."^J, we have 



o E{tr{Wi)) = 0(rf°) and 

o A;,(Tr(M^,J, . . . , Tt{W,^)) = 0(rf°) for r > 2. 
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Then by equation ( 20 ) we have for m 7^ n 



and by equations (21 ) and (p2|) we have for m = n 



cov(Tr(O^M,, ■ ■ ■ O'-AJ, TriO^'A,, ■ ■ ■ 0^-A,J) 

m ( m 



=1 Kr=l 

m 



r=l 



where the indices of the j's and 77's are interpreted modulo m. 

Corollary 40. Let O be a d x d Haar distributed random orthogonal 
matrix. Then for integers m and n 



lim cov(Tr(0™),Tr(0")) 



\m\ 7^ \n\ 
2\m\ \m\ = \n\ 



Proof. Let ei = ■■■ = = sgn(m) and e^+i = ■■■ = em+n = 
sgn(n). Let 7 be the permutation with the two cycles (1,2,..., m)(m + 



1, . . . ,m + n). Then by Proposition 12 



E(Tr(0^i • ■ ■ O'™) Tr(0''"+^ ■ ■ ■ 0^™+")) = ^ (Wg(p), q)d*^''^-^''\ 

and if let U be the partition with blocks the cycles of 7 

E(Tr(0'i ■ ■ ■ O''")) E(Tr(0'™+i ■ ■ ■ 0'"^+") 
= J2 Wg(W,p,g)ci#("''-'). 

p,q<U 

By the multiplicativity of the coefficient of the term of leading order 
of (Wg(p), q) we thus have 

cov(Tr(0^i ■ ■ ■ O^™), Tr(0^'"+i ■ ■ ■ 0^™+")) 

^ (Wg(p),g)d#("^-^) + 0(rf-(™+")+#(P^^)+#("''-«)-^) 

p,q<U 



As in the proof of Theorem 36, if Tip.^q has a singleton [k] then = 
— e^(fc), which is impossible given our construction of e. Thus VTp.^g has 
no singletons. Hence ij^ijp.^q) < (m + n)/2. Thus — (m + n) + ^{p V 
+ i^i'^p-eq) ^ 0) with equality only if p = g and vTp.^p is a pairing. 
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Let (r, s) G p. Either = — or = e^. As in the proof of Theorem 



38 all cycles of p connect the two cycles of 7 and hence |m| = \n\. Also 
in the case in which er = — Cs, we have (7~^(r), 7(5)) G p. There are 
exactly \m\ such p's. In the case = e^, we have {'J~^{r),'y'^{s)) G p. 
There are exactly \m\ such p's. All together there are 2\m\ such p's. 
By Remark [s] the coefficient of c?""/^ in (Wg(p),p) is 1. This gives the 
claimed result. □ 

8. Vanishing of Higher Cumulants of Traces 

Let be a family oi d x d random matrices, containing the 

identity matrix, with a real second order limit distribution. By this we 
mean that as ci — )■ cxd 

o tT{A\f ■ ■ ■ aII"^) converges to if{af^''> ■ ■ ■ a^l"^) for all ii,...,in 

and all ei, . . . , e„; 
o fc2(Tr(4r^ ■ ■ ■ 4^""^), Tr(Af ■ ■ ■ '"+"^)) converges to 

^2{at^ ■ ■ ■ a!t^\ af "t'^ ■ ■ ■ af '"+"^) for alHi, . . . , im+n and all 

• • • 5 ^m+Ji) 

converges to for all r > 3, all ^i, . . . , imi+---+m^ and all ei, . . . , 

CmiH hm.^- 

(23) 

Let O be a Haar distributed d x d random orthogonal matrix whose 
entries are independent from those of {^ jj. In this section we shall 
show that whenever Xi, . . . , Xr be r random variables where each Xi 
is one of the following types: 

o Xi = Tr(Afc) for some fc; or | 
o X, = Tr(O^Mj, ■ ■ ■ 0^"AjJ with eu G {-1, 1} and such \ (24) 
that if Aj^, = I then ek-i = Cfc, where e„+i = ei. J 

The the third and higher cumulants of the X's will converge to as 



> 



d — )■ 00. This, combined with Theorems |36] and [38] will show that we 
have asymptotic real second order freeness of the {^ jj and O. 

For the rest of this section we shall assume that the {^ jj satisfy 



condition (23) and our goal is to prove the theorem below. 



Theorem 41. Suppose that Xi, . . . ,Xr are of the form (24) andr > 3, 
then 

lim kriXi,...,Xr) = 0. (25) 
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We prove this theorem by proving the following result where we 



strengthen the hypothesis in (24) by assuming that the non-constant 
A's are centred. 

i) Xi = Tr(Afc) for some k with E(Tr(Xfe)) = 0; or 



Xi = Tr(O^Mj, • • • O'-AjJ with tk G {-1, 1} and 
such that either E(Tr(y4jj.)) = orAj^, = / and 
ek-i = efc, where e„+i = ei. 



(26) 

Theorem 42. Suppose that whenever Xi, . . . ,Xr are of form (26) and 



r > 3 then 

lim kr{Xi, . . . , Xr) = 0. 

d—^oo 

Proof of Theorem \Jl\ using Theorem We begin by recalling that 
the cumulant kr{X^ . . . ,Xr) will be whenever an Xi is constant and 
r > 2. Recall also that by our assumption of a second order limit 
distribution E(tr(Aj)) is a convergent function of d and thus bounded. 
Thus if kr{Xi, . . . ,Xr) — 7- then so does E{tT{Aj))kr{Xi, . . . 

Suppose Xi = Tr(y4j) for some j. Let Aj = Aj — E(tT{Aj))I. 
Let c = E(tr(Aj)). Then E(Tr(ij)) = and Aj = Aj + cl. Then 
kr{Xi, . . . , Xj_i, cd, Xj+i, . . . , Xr) = and so 

kr{Xi, . . . , Xr) 

= kr{Xi, . . . , cd, . . . , Xr) 

+ kr{Xi, . . . , Tr(y4j), Xj+i, . . . , Xr) 

= kr{Xi, . . . , Xi_i, Tr(y4j), . . . , Xr). 

So we may suppose that any X's of the form Ti{Aj) are centred. 

Next suppose that Xi = Tr(0''i ■ ■ ■ O^'-A^J, with each r]i = ±1 
and whenever Aj^ = J we have rjt = fjt+i- For each i, we shall write Xi = 
TT{O^^Aj-^^---0'^''AjJ as a linear combination of a constant random 
variable and terms of the form Tr(AjJ, or Tt{0'^^ Ak^ ■ ■ ■ O^^Ak,) where 
for each t either E(Tr(AfcJ) = or A^^ = I and fit = /^t+i; where fii+i = 
fii. We then replace Xi in kr{Xi, . . . ,Xr) by this linear combination 



and get a sum of cumulants in which all the A's are of the form (26). 

To show that each Xi = TT{O^^Aj-^ ■ ■ ■ O^^AjJ can be written as such 
a linear combination we replace for each t, Aj^ with Aj^ + E{tT{Aj^))I. 
We then expand this sum. If we have a factor E(tr(AjJ)/, we will 
get cancellation of cyclically adjacent O's wherever rjt = —rjt+i- This 
might bring two centred A's next to each other. As the product will 
not necessarily be such the expectation of the trace is 0, we repeat the 
centring process and continue. Since the number of factors decreases 
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whenever there is a cancellation, the process terminates with either: 

an Xi as in (26 m); or a constant Xi (if all 

□ 



an Xi of the form (26 



the O's get cancelled). 

Remark 43. To illustrate the previous theorem let us consider the ex- 
ample 

h{^T{0A^0-'A2), Ti{OAsOA^), Ti {OA^Q-'Ae)). 

There are six A's and we let Ai = + Cil with Cj = E(Tr(ylj)). This 
produces 2^ terms, some of which are because some of the entries of 
the cumulant are constant. For example we shall get terms such as 

ciC3C4C5fc3(Tr(i2), Tr(0/0/), Tr(i6)). 

If we started with the example 

UTi{OAiO~'A2), TiiOA.O-'A,), Ti {OA.Q-' A,)). 

then we would also get terms like 

CiC3C5A;3(Tr(i2),Tr(i4),Tr(i6)) 

where there no O's. 



Our task now is to prove Theorem 42 We shall recall the moment 
cumulant relation 



Xr 



(27) 



UeV(r) 

So to prove something about the cumulants kr{Xi, . . . , Xr) we shall 
prove something first about E(Xi ■ ■ ■ Xr) and use this to prove Theo- 
We let Vi,2{n) be the partitions of [n] with blocks of size either 



rem 



1 or 2. 
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Theorem 44. Whenever Xi, . . . , Xr are of form ^2(^ then 
E(Xi---X,): 



, Xr 



o 1 



(2^ 



Proof of Theorem UM using Theorem 44 



By Corollary 37 we have that ki{Xi) = 0(1) is Xi is of type (26 ii) and 
ki{Xi) = if Xj is of type (26 i). If Xi^ and Xi^ are both of type (26 ii) 
then by Theorem 38, k2{Xi-^,Xi^) = 0(1). If they are both of type 
(26 i), then by assumption (23) we have ^2(^11,-^12^ 



of type (26 . i) and Xi^ is of type (26 
as E(XjJ = 0. Then by Corollary 
cases ki{Xi^) and k2{Xi^, Xi^) are of order at most 0(1). 



0(1). If X, is 



then k2{Xi„X,,) =E{Xi,Xi, 



37, E{Xi^Xi^) = O(rf'i). So in all 
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Now by (g 

= E{Xi^Xi^Xi^) - ^ kuiXi^, Xi2, Xi^) = o{l). 

Suppose we have shown for 3 < s < / that ks{Xi^, . . . , XiJ = o(l). 
Then 

E(Xj^ ■ ■ ■ Xj J — ^ ku {Xi^ , . . . , Xj J 

= ki{X,„...,Xi^)+ J2 ku{X,„...,X,,) 

wePi,2(0 

Where 7^1,2(0 is all the partitfons in V{1) except those in 7^1,2(0 
1;, the partition with only one block. HUE 7^1,2(0 then U has blocks 
of size 1 or 2 and at least one block of size between 3 and s. Since 
the cumulants from the blocks of order 0(1) and, by our induction 
hypothesis, all others are of order 0{d~^), the product ku{Xi^, . . . , XjJ 
is of order o(l). Hence 

k{Xi„...,X,,)+ kuiX,„...,Xi^)=o{l) 

forces us to conclude that ki{Xi^, . . . , XjJ = o(l). □ 

Notation 45. From now on we shall assume that we have positive 
integers ni, . . . , n^. We let n = rii + ■ ■ ■ + ra^. There is 1 < tq < r such 
that for To < i < r we have rij = 1. We let 7 G 5*^ be the permutation 
with cycles 

(1, . . . , ni) ■ ■ ■ (ni H h rira-i + 1, . . . , ni H h n^o) 

X (rii H +71^0 + Ur^^i) ■ ■ ■ (rii H h + Ur) 

If ro = 1 then 7 = e is the identity permutation. We shall assume the 
random variables Xi are such that for 1 < i < ro 

o Xi = Tr(0^"i+-+"-i+M„,+...+„^_,+i ■ • ■0^"i+-+".A„,+...+„J 
where for each ni + ■ ■ ■ + n.i_i + l<t<ni + -- - + ni either 
E(IV(At)) = or A = / and et = e^(t)] 
and for tq < i < r 

o Xi = Tr(A„,+...+„J and E(X,) = 0. 

Let m = rziH l-rirQ-i- If m is odd and positive then E(Xi ■ ■ ■ Xr) = 0. 

So we shall assume that m is even, and possibly 0. Let V2{fn,n) be 
the set of partitions of [n] whose restriction to [m] is a pairing and all 
of whose other blocks are singletons. In the case tq = 1 we have m = 
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and the only partition in V2{fn,n) is the one with n blocks of size 1. 
We assume that e G with = 1 for i > m. 

Now let p and q be in V2{'m,n). Then pSqS is a permutation of [±n] 
whose restriction to [±m] is a pairing and all of whose other cycles are 
singletons. Now consider 'yZ^5^p5q55e'y- Its restriction to [±n] \ [±m] 
consists of singletons. Its restriction to [±m] is as in Notation 11, i.e. 



the cycles occur in pairs {c, c'}. We obtained a permutation, vTp.^g, of 
[m] as follows. For each pair we choose one representative, replacing 
any negative entries by their absolute values. Now we wish to extend 
this construction to the case where p,q & V2{Tn,n). The cycles in 
[in] \ [±m] also occur in pairs {~k){k) (with k > 0) and so we just 
choose (k) for each of these cycles. Also for m < k < nlet rip.^q{k) = 1. 



Let Xi, . . . ,Xr satisfy (26 ) and let us expand E(Xi ■ ■ ■ Xr) as follows. 

E{X,---Xr) 

= E (Wg(p), q) E(Tr(.^.^„,^.^,)(Ai, . . . , A^)). 

We need to find the order of E{Tt(^^^,^^,^^,^^){Ai, An)). 
Proposition 46. If m > 2 and TTp.^g\[fn] is not a pairing then 

E(Tr(.,.,„,,.,,)(Ai,...,A0) = O(ci™/2-^). 
If T^p.^qllm] is a pairing or if m = then 
E(Tr(.,.,„,,.,,)(Ai,...,AJ) 

= E^p..,lM(TrK.,lM/'?P.,l[H)("^i' • • • '^™)) E(Tr(A^+i) ■ ■ ■ Tr(A„)) 
+ 0(c/'"/2-i). 

Proof. Let follow the notation used in Equation ([9]). If W is a partition 
on [n] and vr any permutation of [n] we write Eu(Ttt,{Ai, . . . , An)) to 
be the product Y['i=i^{'~^^ni{Ai, . . . , An)), where the blocks of U are 
{Ui, . . . , Uk} and tTj = Tr\u,. We likewise let fct/(Tr,r(^i, • • • , An)) be the 
product of cumulants along the blocks of U, see equation ([To|. Recall 
that we then have the moment- cumulant relation 

E(Tr(.,.,„,,.,,)(v4i,...,A„)) 
= /^w(Tr(.,.,,,,,.,,)(A,...,A„)). (29) 



By our assumption (23) on the existence of a real second order limit 
distribution of the A's we have 

^^i(Tr(.,.,„,,.,,)(A---,^n)) = 0(O 
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where u is the number of blocks of lA that contain only one cycle of 
TTp.^q. Suppose /ci7(Tr(^p,^^,^^.^^)(A, . . . , ^ 0. Then any block of U 
that contains a single cycle of vr^.^g must contain a cycle of T^p-^q\[n]) as 
E(Tr(y4,fc)) = for m < /c < n. Thus u < ij^{T^p.^q\[m])- Also recall, from 



the fourth paragraph of the proof of Theorem 36 , that if {k) is a single- 
ton of 7rp.^g|[m] then E(Tr(Afc)) = 0, and hence A;i^(Tr(^^.^^,^p,^^)(y4i, . . . , 
An)) = 0. So for any block U oiU that contains only one cycle of vr^.^g, 
f/ must contain at least two elements. Thus u < m/2. We can only 
have u = m/2 when every block of U\[m] contains one cycle of np.^q\im] 
and that cycle has two elements, i.e. np.^g\[m] is a pairing. This proves 
the first claim. 

If TTp.^qlim] is a pairing then we have just seen that to have u = m/2 
we must have U\[m] = T^p.^q\im]- Thus if we only consider Ws for which 

W|[m] = T^p;q\[m] WC haVC 

E(Tr(^,.,„,,.,,)(Ai,...,A„)) 

~ ^-^p-cq\[m] C^^('rp-Eq|[m],»?p.e5|[m])(^l5 • • • 5 ^m)) 

X J2 ku'{TT{Arn+l),...,TT{A^)) 

U'eV([m+l,n]) 

= E^p-.,I[hC^^W-.9I[H.'?p-.9Im)*^^1' • • • ' ^™)) E(Tr(Am+i), . . . , Tr(Am)) 
Finally we add back the remaining terms to obtain that 

E(TV(.,.,„.,.,,)(Ai,...,A„)) 
= E.p..,l[H(Trw,,|[„,,^,,,|[,„])(Ai, . . . , A^)) E(Tr(Am+i), . . . , Tr(Am)) 

+ 0(ci™/'-^). 

□ 

Notation 47. Suppose we have ro,r,m,n and 7 and e as in Notation 



45 Let ^(7,e,m,n) be the set of partitions p G V2{m^n) such that 
7'"p-eplH is a pairing, the condition being vacuously satisfied when m = 
0. For p G ^(7, e, m, n) let 

^p(Ai, . . . , A^) 
= d / E^p.^j^lj^j (Tr(^p.^plj^j^^p,^pli^j)(Ai, . . . , Am)) 
xE(Tr(Am+i)---Tr(A„)). 



Corollary 48. Suppose Xi, . . . satisfy (26). Then 



E(Xi---X,)= ^ £:p(Ai,...,AJ + 0(r^). 

pe^(7,e,m,,n) 
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Proof. When m = there is nothing to prove. According to Proposi- 
tion I 



E(Xi---X,) 

= Yl (Wg(p),g)E(Tr(.^ 



){Ai,...,An)). 



p,q&'P2 {m,n) 



By Proposition 46, if iip.^qlim] is not a pairing we have 

E(Tr(.,..,,,,..,)(^,...,A.)) = 0(rf-/2-^) 

and (Wg(p),g) = 0(rf-"+#(P^'?)). So 

(Wg(p), g) E(Tr(.^.^„,^.^,)(Ai, . . . , A„)) = 0(^/-i). 

Also if V g) < n/2 (i.e. p q) we get the same conclusion. When 
p = g and VTp.^pljm] is a pairing, then p G ^(7, e, m, n) and 

(Wg(p), q) E(Tr(.^.^^,,^,^,)(Ai, . . . , = . . . , A„) + O(ci-i) 

because (Wg(p),p) = rf-"/^ + 0(rf-"/2-i). □ 



Proof of Theorem 44 ' To prove the theorem we show that 

J2 ku{X,,...,Xr)= Yl Sp{A,,...,A^)+o{l) (30) 



and then apply Corollary 48 We saw in the proof of Theorem 42 that 
if is of type (26 i) and Xj^ is of type (26 ii) then A;2(Xjj,Xj2) = 
0{d^^), so on the left hand side of (30) we only have to consider Ws 
for which each block is either contained in [m] or in [m + 1, ra]. Thus 

ku{Xi, . . . ,Xr) 



J2 fcw(Xi,...,X,,J J2 h{Xr,+l,...,Xr)+0{l] 

WeP2(r-o) V6P2([ro+l,r-]) 



By assumption (23) we have 

J2 MXro+i, . . . , X,) = E(X„+i ■ ■ ■ X„) + 0(1) 

VePi,2{[ro+l,r]) 

because cumulants corresponding to blocks of size three or larger are 
0(1) and cumulants corresponding to blocks of size two are 0(1) and 
cumulants corresponding to blocks of size one are 0. 
Let us next show that 

J2 ku{X^,...,Xr,) 
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d-^/'Y. E.^.^^(Tr(.^_,^.^^)(Ai,...,AJ) + 0(^-1). (31) 

pGP2('Tl) 
TTp.jp a pairing 



If we multiply these last two equations we get equation (30) as 

^p(^l5 • • • 5 ^n) 

= c?"™/^ E^j,.^j,(Tr(^p.^^_^j,.^p)(Ai, . . . , A^)) E{Xm+i ■ ■ ■ X^). 

To prove (31) we use (12) and (18). They say that a first and second 
cumulant of X's if type (26. ii) can be written, up to terms of order 
0{d~^), as sums over pairings p in unions of intervals of 7 for which 
TTp.^p is a pairing. Moreover by Corollary 22 if p G 7^2 (^) is a pairing 
and TTp.^p is also a pairing then at most two cycles of 7 can be contained 
in any block of p V 7. 

Let p G V2{m) be a pairing such that Hp.^p is a pairing. The partition 
pVj determines a partition Up G 'P(ro) of the cycles of 7. By Corollary 
Up G Pi,2('"o)- Thus we can write 

5^ E.^,^^(Tr(.^.^^,,^.^^)(Ai,...,A^)) 



22 



W67'i,2(r-o) 



pe^(7,e,»n) 



So to prove (31 ) it suffices to prove that for U G 7^1,2(^0) 

= E E....(t%P.P,>..)(^i---^-)) + 0(^"')- (32) 

Up=U 

Now ku{Xi, . . . ,Xro) is a product of first and second cumulants. For 
each first cumulant, E{Xj), we apply equation (12) to write 

E(X,) = d~-^/'Y.^^^-J^'(-r>:r>,V.:.Mn, ■ ■ -.AJ) + Oid~') 
P 

with p running over pairings of the corresponding cycle {ii, . . . , is) of 7 
such that Tip.^p is a pairing. 

For each second cumulant k2{Xk, Xi) we apply equation (jlsj) to write 



cov 



with p running over pairings that connect the corresponding union 
(ii) • • • yjt) of two cycles of 7 such that iip.^p is a pairing. Taking the 
product of these equations gives us (32). □ 
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9. Main Results on Asymptotic 
Real Second Order Freeness 



In this section we will present some consequences of Theorems [36 
EaandiH 



Theorem 49. The ensemble of Haar distributed orthogonal random 
matrices has a real second order limit distribution. 



Proof. Corollaries 10 and 40 show that an ensemble of Haar orthog- 
onal matrices has convergent moments {E(tr(0"^))}d and convergent 
fluctuation moments {/c2(Tr(0'^), Tr(0"))}rf. A particular example of 



Theorem 41 is the case when we have A;r(Tr(0'^^), . . . , Tr(0™''')) for 
some non-zero integers mi, . . . ,771^. Together these results then show 
that an ensemble of Haar orthogonal random matrices has a real second 
order limit distribution. □ 

Theorem 50. Suppose {Ai\i is an ensemble of random matrices with 
a real second order limit distribution and O is an ensemble of Haar 
distributed orthogonal random matrices. If the entries of {Ai}i are 
independent from those of O, then {Aji and O are asymptotically real 
second order free. 



Proof. This is a consequence of Theorems 36 , 38 and 41 □ 



Theorem 51. Let Oi, . . . ,0s be independent Haar distributed orthog- 
onal random matrices. Then Oi, . . . ,0s are asymptotically real second 
order free. 

Proof. A single O has a real second order limit distribution by Theorem 



49 By Theorem 50, Oi and O2 are asymptotically real second order 



free. Again by Theorem 50 {Oi,02} and O3 are asymptotically real 
second order free. By Proposition |29| Oi, O2, and O3 are asymptoti- 
cally real second order free. Then we can proceed by induction. □ 

Proposition 52. Suppose {Ai}i and {Bj}j are two independent fam- 
ilies of d X d random matrices, each having a real second order limit 
distribution, and suppose that O is a d x d Haar orthogonal matrix in- 
dependent from {Ai}iU{Bj}j. Then {Bj}i and {OAiO~^}i are asymp- 
totically real second order free. 

Proof. We do not know that {Ai}i U {Bj}j has a real second order 



limit distribution so we cannot directly apply Theorems 36, 38 and 41 



We shall argue that because of the special nature of the words we are 
considering, i.e. OAi-^^O'^Bj^OAi^O'^Bj^ ■ ■ ■ OAi^O~^Bj^, the proofs 
can be modified so that we only need the independence of {Ai}i and 
{Bj}j and the fact that the exponents of the O's alternate in sign. 
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Consider the expression 

E(Tr(.,.^„,,.^,)(Fi,...,y„)) 



appearing in the statement of Proposition [12} If we write 

TrK.,„,,.,,)(ri, . . . , F.) = Tr(Zi) ■ ■ ■ Tr(Z,) 

as a product along the cycles ci ■ ■ ■ os vTp.^g, then the existence of a 
real second order limit distribution was used to conclude that 

d^^ki(TT{Zi)) converges, 

/c2(Tr(Zj), Tr(Zj)) converges, and 

fc,(Tr(Z,J, . . . , Tr(Z,J) = o(l) for r > 3. 



This was all we needed to prove Theorems [36| 38 and 41 We shall 
show that we still have these three properties even though we do not 
assume that {Ai}i U {Bj}j has a real second order limit distribution. 

So let ni, n2, . . . , be even positive integers and n = rii + ■ ■ ■ + rij.. 
Let 

7 = (1, . . . , r;,i)(r;,i + l, . . . ,^1+^2) ■ ■ ■ (niH hn^-i + l, • • • ,TiiH rir) 

be the permutation in Sn with the cycle decomposition given above. 
Let Yi, Fs, . . . , Yn-i be polynomials in {v4j}j and Y2, Y^, . . . ,Yn be poly- 



nomials in {Bj}j. By Proposition 12 we have 



E(Tr^(OFi, O-IF2, . . . , OF„_i, O-^F^)) 
= E (Wg(p),g)E(Tr(.^.^,,,^.^^)(Fi,...,y„). 

Now by Lemma [13] 

E(Tr(.,.^„,,.^,)(yi, . . . , y.) = E(Tr(Zi) ■ ■ ■ Tr(Zfc)) 

where each Zi is a polynomial in either {Ai}i or in {-Bj}j. In fact we 
may suppose that Zi, . . . , Zi are polynomials in {Ai}i and Zi^i, . . . , Zk 
are polynomials in {Bj}j. Then we have 

E(Tr^(Ori, 0''Y2, OYn-i, Q-'Y^)) 

= Yl (Wg(p),g)E(Tr(ZO---Tr(Z,)) 

p,geP2(n) 

xE(Tr(Z,+i)---Tr(Z,)) (33) 

by the independence of the {Ai}i and the {Bj}j. This means that as 
far as the asymptotic behaviour of E(Tr(^p._^^ ,,p^^)(Yi, . . . , Yn)) is con- 
cerned we may assume that {Ai}i U {Bj}j does have a real second 
order limit distribution. Now having cleared this hurdle we have by 



the proof of Theorem 36 that {OAiO and {Bj}j are first order 
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free. Likewise, the proof of Theorem 41 can be apphed to conclude 
that all third and higher cumulants of traces of products of OAiO~^'s 
and B/s are of order o(l) as d oo. We shall conclude the proof by 
showing that Theorem 38 and equation (33) will give us condition {ii) 
of Definition [25l 

So let us consider centred random matrices Xi , . . . , and Yi , . . . F„ 
where Xi, X^, . . . X^-i and Yi, la, . . . are polynomials in {Ai}i 
and X2, X2, . . . , Xm and I2, Ki, . . . , y„ are polynomials in {Bj}j. Let 
the second order limit distribution of Xi, . . . , X^, and Yi, . . . ,Yn be 
given by xi, . . . , x„ and . . . , ?/„ respectively. 

By equation ( 14 ) we have for m = n 

lim cov(Tr(OXiO~^X2 ■ ■ ■ O^^X^), Tr(Ori ■ ■ ■ 0~^Yn)) 



m I m 



r=l \ i=l i=l 

Since = (—1)*, we have both 6^ -e 1 , 

^ ^ '''' 7 *"T'-'-(m + r) 

only when r is even; see Figure [5j Thus 



(m + r) 



1 and e . = 1 



m ( m 



r=l I i=l 



7 ^"T' (m + r) 



m/2 



7* (m + r) 



t 



m m 

Y \ n V^^iV^r-i) + n '^(^i?/2r+*; 
r=l j=l i=l 



For i odd we write ^p{xiy2r-i) = '^{oxio oy2r-iO ). Then 



(34) 



m/2 



r=l I j=l 



1=1 



m/2 [ m/2 

{ Wv{{0X2i^l0'^){0y2r-(2i-l)0'^))v{^2iy2r-2i) 
r=l I i=l 

m/2 

+ W'^{{.OX2i-lO'^){oy2r+2i-lOy)'^{,X2tylr+2i) 
i=l 



This shows that condition iii) of Definition 25 is satisfied. 



□ 



Definition 53. A random matrix is said to be invariant under conju- 
gation by an orthogonal matrix if the joint distribution of the entries 
is invariant under conjugation by an orthogonal matrix. So if we let A 
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Figure 5. When = (—1)* the only spoke diagrams 
that make a contribution are those where we connect an 
o to an o~^. This means we can only connect an a to a 6 
if the indices have the same parity. This is what we see 
in equation (34). 



be a random matrix, O be a orthogonal matrix and B = OAO ^ then 
we mean that for every ii, . . . , in, i-i, ■ ■ ■ , i-n "we have 

Many standard examples of random matrices are invariant under 
conjugation by a unitary or orthogonal matrix. In particular, real 
Wishart matrices, the Gaussian orthogonal ensemble, Ginibre matri- 
ces, and orthogonal matrices are all invariant under conjugation by an 
orthogonal matrix. In jRij [R2I , Redelmeier these were shown to have 
real second order limit distributions and so satisfy the hypothesis of 
our theorem below. 

Theorem 54. Suppose that {Ai}i and {Bj}j are two independent fam- 
ilies of random matrices, each with real second order limit distribution. 
Suppose also that the family {Ai}i is invariant under conjugation by 
an orthogonal matrix. Then and {Bj}j are asymptotically real 

second order free. 

Proof. Since the joint distribution of the entries of Ai and OAiO^^ 
are the same we may replace {Ai}i by {OAiO^^}i and then apply 



Proposition 52 □ 



10. Concluding Remark 

Let us consider {Ai}i and {Bi}i two independent ensembles of ran- 
dom matrices, each with a real second order limit distribution and 
suppose that the ensemble {Ai}i is invariant under a conjugation by a 
unitary matrix. In |mss it is shown that {Ai}i and {-B/}/ are asymp- 



totically complex second order free (see |mss] . Corollary 3.16). Since 
orthogonal matrices are also unitary. Theorem 54 implies that {Aj}, 
and {Bi}i are asymptotically both real and complex second order free. 
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In particular, the second term on the right-hand side of equation 
must vanish. In consequence, for Ai,A2 G {Ai}i we have that 

lim tT{AiAl) = 0. 

d—^oo 

The connection between ensembles of random matrices which are in- 
variant under a conjugation with a unitary and real second order free- 
ness goes deeper than this and is investigated in the subsequent paper 
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